2026-03-27 12:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 12:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 12:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-27 12:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-27 12:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 12:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 12:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 12:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 12:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: 67efbcd1339eb1b3
2026-03-27 12:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 12:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-27T12_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 12:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 12:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 12:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 12:00:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 12:00:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2122
2026-03-27 12:00:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 12:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 12:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 12:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 12:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 12:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 12:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 12:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-27 12:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 12:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 12:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 12:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-27 12:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-27 12:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 12:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 12:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 12:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 12:00:18 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1060 | hits on page: 40
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for AA56023: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for UY50656: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for FB63193: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for HX62169: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: DB38176
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB38176%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for DB38176: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: YJ25285
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ25285%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for YJ25285: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for SB99593: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for JJ87309: 1
2026-03-27 12:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: XR93243
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR93243%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for XR93243: 1
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for EY20513: 1
2026-03-27 12:00:18 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-27 12:00:18 [auto1.nl] INFO: Scrape type for AE74076: 2
2026-03-27 12:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-27 12:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-27 12:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab50ad30-551e-593f-932a-277391e9665f with scrape type 2
2026-03-27 12:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ab50ad30-551e-593f-932a-277391e9665f, identifier: AE74076
2026-03-27 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 12:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076
2026-03-27 12:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ab50ad30-551e-593f-932a-277391e9665f with identifier: AE74076 to the API
2026-03-27 12:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:17Z',
 'fuel_type': 'diesel',
 'id': 'ab50ad30-551e-593f-932a-277391e9665f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE74076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-27 12:00:23 [auto1.nl] INFO: Saving data for AE74076: {'auction_closing_time': 1774714877.0, 'created_time': 1773408608.229345, 'last_price_update_time': 1774612823.752708}
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE74076') HTTP/1.1" 204 0
2026-03-27 12:00:23 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-27 12:00:23 [auto1.nl] INFO: Scrape type for VA70092: 2
2026-03-27 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-27 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-27 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d2af2a-6313-5974-93fa-2234f5bbc454 with scrape type 2
2026-03-27 12:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6d2af2a-6313-5974-93fa-2234f5bbc454, identifier: VA70092
2026-03-27 12:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-27 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092
2026-03-27 12:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6d2af2a-6313-5974-93fa-2234f5bbc454 with identifier: VA70092 to the API
2026-03-27 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:32Z',
 'fuel_type': 'petrol',
 'id': 'e6d2af2a-6313-5974-93fa-2234f5bbc454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA70092',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 97682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Saving data for VA70092: {'auction_closing_time': 1774715672.0, 'created_time': 1773946982.168265, 'last_price_update_time': 1774612832.42328}
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA70092') HTTP/1.1" 204 0
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for VT73125: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for SA65575: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for PD24155: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for WS58210: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for US57687: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for AB05434: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for HY50584: 1
2026-03-27 12:00:32 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-27 12:00:32 [auto1.nl] INFO: Scrape type for BD38212: 2
2026-03-27 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-27 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-27 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f626f2aa-bd02-5806-afd1-4a4942fb0066 with scrape type 2
2026-03-27 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f626f2aa-bd02-5806-afd1-4a4942fb0066, identifier: BD38212
2026-03-27 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212
2026-03-27 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f626f2aa-bd02-5806-afd1-4a4942fb0066 with identifier: BD38212 to the API
2026-03-27 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:13:08Z',
 'fuel_type': 'petrol',
 'id': 'f626f2aa-bd02-5806-afd1-4a4942fb0066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD38212',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 118750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-27 12:00:40 [auto1.nl] INFO: Saving data for BD38212: {'auction_closing_time': 1774714388.0, 'created_time': 1773133233.390175, 'last_price_update_time': 1774612840.397649}
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD38212') HTTP/1.1" 204 0
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB38176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ25285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB99593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB63193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX62169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA56023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY50656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:40 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1060 | hits on page: 40
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 12:00:40 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AA56023/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: DB38176
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: YJ25285
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: XR93243
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-27 12:00:40 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-27 12:00:40 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-27 12:00:40 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-27 12:00:40 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS58210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY20513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ87309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR93243/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA65575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD24155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT73125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US57687/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB05434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB38176> (referer: https://www.auto1.com/v1/car-details-view/DB38176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1a139de-77db-5b67-accc-7706ed1ca697 with identifier: DB38176
2026-03-27 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a139de-77db-5b67-accc-7706ed1ca697 with scrape type 1
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_56d23963d09c3ab3475390c4aba362aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_56d23963d09c3ab3475390c4aba362aa.jpg not downloaded yet
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg not downloaded yet
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_d8ec5d0fbcd8f1700389025db408a123.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_d8ec5d0fbcd8f1700389025db408a123.jpg not downloaded yet
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_833e13da3a3edb693127e3302857cf54.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_833e13da3a3edb693127e3302857cf54.jpg not downloaded yet
2026-03-27 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY50656> (referer: https://www.auto1.com/v1/car-details-view/UY50656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg not downloaded yet
2026-03-27 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg not downloaded yet
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg not downloaded yet
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg not downloaded yet
2026-03-27 12:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ25285> (referer: https://www.auto1.com/v1/car-details-view/YJ25285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_2108be6597484e9f0d11ff3b7397652a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_2108be6597484e9f0d11ff3b7397652a.jpg not downloaded yet
2026-03-27 12:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_fde122ff6853146ff943567e7d9414f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_fde122ff6853146ff943567e7d9414f0.jpg not downloaded yet
2026-03-27 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-27 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with scrape type 1
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d4cf50c9-964f-59d3-8fb8-81f2be8f9532
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F02%252Fe702f2a619cdfb86ded71ebf8032f881%252Fpa%252FUY50656_fecf1ac67319a0fce897b257b25562d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_fecf1ac67319a0fce897b257b25562d6.jpg already downloaded
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F02%252Fe702f2a619cdfb86ded71ebf8032f881%252Fpa%252FUY50656_c60bd72f8a7a7fbf4b65b63d6f4fe990.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_c60bd72f8a7a7fbf4b65b63d6f4fe990.jpg already downloaded
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F02%252Fe702f2a619cdfb86ded71ebf8032f881%252Fpa%252FUY50656_a7d434d939254bf2329082b9b0705c91.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_a7d434d939254bf2329082b9b0705c91.jpg already downloaded
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F02%252Fe702f2a619cdfb86ded71ebf8032f881%252Fpa%252FUY50656_6b4a64d456e0aa8e6f8ba3ac64a3e79d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_6b4a64d456e0aa8e6f8ba3ac64a3e79d.jpg already downloaded
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F02%252Fe702f2a619cdfb86ded71ebf8032f881%252Fpa%252FUY50656_91a8975ce1299af77e64fbd2398ce36a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_91a8975ce1299af77e64fbd2398ce36a.jpg already downloaded
2026-03-27 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d4cf50c9-964f-59d3-8fb8-81f2be8f9532, identifier: UY50656
2026-03-27 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-27 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656
2026-03-27 12:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d4cf50c9-964f-59d3-8fb8-81f2be8f9532 with identifier: UY50656 to the API
2026-03-27 12:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UY50656>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': 'd4cf50c9-964f-59d3-8fb8-81f2be8f9532',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '17JXH8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY50656',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 396705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_fecf1ac67319a0fce897b257b25562d6.jpg',
                'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_c60bd72f8a7a7fbf4b65b63d6f4fe990.jpg',
                'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_a7d434d939254bf2329082b9b0705c91.jpg',
                'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_6b4a64d456e0aa8e6f8ba3ac64a3e79d.jpg',
                'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_91a8975ce1299af77e64fbd2398ce36a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4cf50c9-964f-59d3-8fb8-81f2be8f9532/d4cf50c9-964f-59d3-8fb8-81f2be8f9532_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_fecf1ac67319a0fce897b257b25562d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4cf50c9-964f-59d3-8fb8-81f2be8f9532/d4cf50c9-964f-59d3-8fb8-81f2be8f9532_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_c60bd72f8a7a7fbf4b65b63d6f4fe990.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4cf50c9-964f-59d3-8fb8-81f2be8f9532/d4cf50c9-964f-59d3-8fb8-81f2be8f9532_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_a7d434d939254bf2329082b9b0705c91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4cf50c9-964f-59d3-8fb8-81f2be8f9532/d4cf50c9-964f-59d3-8fb8-81f2be8f9532_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_6b4a64d456e0aa8e6f8ba3ac64a3e79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4cf50c9-964f-59d3-8fb8-81f2be8f9532/d4cf50c9-964f-59d3-8fb8-81f2be8f9532_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/02/e702f2a619cdfb86ded71ebf8032f881/pa/UY50656_91a8975ce1299af77e64fbd2398ce36a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [auto1.nl] INFO: Saving data for UY50656: {'created_time': 1774612848.256076, 'last_price_update_time': 1774612848.256086, 'auction_closing_time': 1774714335.0}
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY50656') HTTP/1.1" 204 0
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS58210> (referer: https://www.auto1.com/v1/car-details-view/WS58210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA56023> (referer: https://www.auto1.com/v1/car-details-view/AA56023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238907a7-1980-5280-a945-a254e51275e0 with identifier: YJ25285
2026-03-27 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238907a7-1980-5280-a945-a254e51275e0 with scrape type 1
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg not downloaded yet
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB99593> (referer: https://www.auto1.com/v1/car-details-view/SB99593/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX62169> (referer: https://www.auto1.com/v1/car-details-view/HX62169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY50584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_0192e7a61b8c36f103d16805fa55712a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0192e7a61b8c36f103d16805fa55712a.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg not downloaded yet
2026-03-27 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-27 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801aae17-b240-55c5-a7ff-feed6976a1dc with scrape type 1
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_ec79606840c3b08e281fc0d38fd4845d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_ec79606840c3b08e281fc0d38fd4845d.jpg not downloaded yet
2026-03-27 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-27 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 1
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_a902338e00f05e81b6c2916ede5601e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a902338e00f05e81b6c2916ede5601e3.jpg not downloaded yet
2026-03-27 12:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_833e13da3a3edb693127e3302857cf54.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_4640a4189711298bd75a1c70cf3f30cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_4640a4189711298bd75a1c70cf3f30cd.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_cdb838a41789953117e55bbb2e21ad41.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_cdb838a41789953117e55bbb2e21ad41.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg not downloaded yet
2026-03-27 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-27 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba758880-b6e0-5a79-a87e-f00119eb694c with scrape type 1
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ba758880-b6e0-5a79-a87e-f00119eb694c
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Faf%252F99afaeb0bfbf51c6f0dca76f825d110b%252Fpa%252FSB99593_05552f75b1a066d28e65d54e4ceab262.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_05552f75b1a066d28e65d54e4ceab262.jpg already downloaded
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Faf%252F99afaeb0bfbf51c6f0dca76f825d110b%252Fpa%252FSB99593_00d8545b0eb2ec82297550a4959343eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_00d8545b0eb2ec82297550a4959343eb.jpg already downloaded
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Faf%252F99afaeb0bfbf51c6f0dca76f825d110b%252Fpa%252FSB99593_bb30fca90dbd574540f1f1cbcee7ef74.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_bb30fca90dbd574540f1f1cbcee7ef74.jpg already downloaded
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Faf%252F99afaeb0bfbf51c6f0dca76f825d110b%252Fpa%252FSB99593_1f7c89769a8e1c66ab3c3a5f80381bd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_1f7c89769a8e1c66ab3c3a5f80381bd5.jpg already downloaded
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Faf%252F99afaeb0bfbf51c6f0dca76f825d110b%252Fpa%252FSB99593_82a6d881835ff2a650e31a23cca3ccae.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_82a6d881835ff2a650e31a23cca3ccae.jpg already downloaded
2026-03-27 12:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ba758880-b6e0-5a79-a87e-f00119eb694c, identifier: SB99593
2026-03-27 12:00:48 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1060 | hits on page: 40
2026-03-27 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-27 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 1
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_d6aed847840657fcd642a0fd409a17e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_d6aed847840657fcd642a0fd409a17e0.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg not downloaded yet
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg not downloaded yet
2026-03-27 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-27 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593
2026-03-27 12:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ba758880-b6e0-5a79-a87e-f00119eb694c with identifier: SB99593 to the API
2026-03-27 12:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB99593>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:18:18Z',
 'fuel_type': 'petrol',
 'id': 'ba758880-b6e0-5a79-a87e-f00119eb694c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '76HVZ4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB99593',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '5er',
 'odometer': 237606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_05552f75b1a066d28e65d54e4ceab262.jpg',
                'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_00d8545b0eb2ec82297550a4959343eb.jpg',
                'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_bb30fca90dbd574540f1f1cbcee7ef74.jpg',
                'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_1f7c89769a8e1c66ab3c3a5f80381bd5.jpg',
                'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_82a6d881835ff2a650e31a23cca3ccae.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba758880-b6e0-5a79-a87e-f00119eb694c/ba758880-b6e0-5a79-a87e-f00119eb694c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_05552f75b1a066d28e65d54e4ceab262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba758880-b6e0-5a79-a87e-f00119eb694c/ba758880-b6e0-5a79-a87e-f00119eb694c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_00d8545b0eb2ec82297550a4959343eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba758880-b6e0-5a79-a87e-f00119eb694c/ba758880-b6e0-5a79-a87e-f00119eb694c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_bb30fca90dbd574540f1f1cbcee7ef74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba758880-b6e0-5a79-a87e-f00119eb694c/ba758880-b6e0-5a79-a87e-f00119eb694c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_1f7c89769a8e1c66ab3c3a5f80381bd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ba758880-b6e0-5a79-a87e-f00119eb694c/ba758880-b6e0-5a79-a87e-f00119eb694c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/af/99afaeb0bfbf51c6f0dca76f825d110b/pa/SB99593_82a6d881835ff2a650e31a23cca3ccae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [auto1.nl] INFO: Saving data for SB99593: {'created_time': 1774612851.256512, 'last_price_update_time': 1774612851.256522, 'auction_closing_time': 1774714698.0}
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB99593') HTTP/1.1" 204 0
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [auto1.nl] INFO: Scrape type for LG57021: 1
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_a30a41a73466ead3b58266a401eaf984.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_a30a41a73466ead3b58266a401eaf984.jpg not downloaded yet
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg not downloaded yet
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_2775c22c07a4f36c1ec9f19554547d81.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2775c22c07a4f36c1ec9f19554547d81.jpg not downloaded yet
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB63193> (referer: https://www.auto1.com/v1/car-details-view/FB63193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY20513> (referer: https://www.auto1.com/v1/car-details-view/EY20513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec510d0>
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_833e13da3a3edb693127e3302857cf54.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_833e13da3a3edb693127e3302857cf54.jpg saved to cache
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_2108be6597484e9f0d11ff3b7397652a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [auto1.nl] INFO: Scrape type for DK58919: 2
2026-03-27 12:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-27 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78c3fcff-a822-538d-96be-9ad21dd66132 with scrape type 2
2026-03-27 12:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78c3fcff-a822-538d-96be-9ad21dd66132, identifier: DK58919
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg not downloaded yet
2026-03-27 12:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_fde122ff6853146ff943567e7d9414f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_2f90230f26834b73b38989acbd073914.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_2f90230f26834b73b38989acbd073914.jpg not downloaded yet
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_51eb48ed15eee26906887a413c1e9ee1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_51eb48ed15eee26906887a413c1e9ee1.jpg not downloaded yet
2026-03-27 12:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 12:00:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919
2026-03-27 12:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78c3fcff-a822-538d-96be-9ad21dd66132 with identifier: DK58919 to the API
2026-03-27 12:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:36:31Z',
 'fuel_type': 'diesel',
 'id': '78c3fcff-a822-538d-96be-9ad21dd66132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK58919',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 171371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-15',
 'seller_name': None,
 'title': 'Opel Vivaro 1.9 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2003}
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [auto1.nl] INFO: Saving data for DK58919: {'auction_closing_time': 1774715791.0, 'created_time': 1773231838.862376, 'last_price_update_time': 1774612853.175539}
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK58919') HTTP/1.1" 204 0
2026-03-27 12:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:53 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB92284%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [auto1.nl] INFO: Scrape type for AB92284: 1
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_bcdd0af97f313940828871ec22bb5894.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_bcdd0af97f313940828871ec22bb5894.jpg not downloaded yet
2026-03-27 12:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be129850>
2026-03-27 12:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg saved to cache
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-27 12:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2a70d3-ef31-5641-b052-e688b6b845c0 with scrape type 1
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_6ade446f509c35e178c54ad1253ffed9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_6ade446f509c35e178c54ad1253ffed9.jpg not downloaded yet
2026-03-27 12:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-27 12:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 277a7449-17f7-5d23-a41d-52df33e78d0d with scrape type 1
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 277a7449-17f7-5d23-a41d-52df33e78d0d
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F0e%252F750eab36b6dc8324d660af552e0fec9e%252Fpa%252FEY20513_b9f090a361114a795c91c28e48e6f2de.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_b9f090a361114a795c91c28e48e6f2de.jpg already downloaded
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F0e%252F750eab36b6dc8324d660af552e0fec9e%252Fpa%252FEY20513_9a2bbd58c472141daee2a4736bae5e9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_9a2bbd58c472141daee2a4736bae5e9b.jpg already downloaded
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F0e%252F750eab36b6dc8324d660af552e0fec9e%252Fpa%252FEY20513_5a6e5a50b383c77721c96972e50a199b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_5a6e5a50b383c77721c96972e50a199b.jpg already downloaded
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F0e%252F750eab36b6dc8324d660af552e0fec9e%252Fpa%252FEY20513_932a3e0521318af78665c1fa7999a523.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_932a3e0521318af78665c1fa7999a523.jpg already downloaded
2026-03-27 12:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 277a7449-17f7-5d23-a41d-52df33e78d0d, identifier: EY20513
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg not downloaded yet
2026-03-27 12:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 12:00:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513
2026-03-27 12:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 277a7449-17f7-5d23-a41d-52df33e78d0d with identifier: EY20513 to the API
2026-03-27 12:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY20513>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:58:26Z',
 'fuel_type': 'petrol',
 'id': '277a7449-17f7-5d23-a41d-52df33e78d0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '20ZHXX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY20513',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 125362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_b9f090a361114a795c91c28e48e6f2de.jpg',
                'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_9a2bbd58c472141daee2a4736bae5e9b.jpg',
                'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_5a6e5a50b383c77721c96972e50a199b.jpg',
                'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_932a3e0521318af78665c1fa7999a523.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_277a7449-17f7-5d23-a41d-52df33e78d0d/277a7449-17f7-5d23-a41d-52df33e78d0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_b9f090a361114a795c91c28e48e6f2de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_277a7449-17f7-5d23-a41d-52df33e78d0d/277a7449-17f7-5d23-a41d-52df33e78d0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_9a2bbd58c472141daee2a4736bae5e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_277a7449-17f7-5d23-a41d-52df33e78d0d/277a7449-17f7-5d23-a41d-52df33e78d0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_5a6e5a50b383c77721c96972e50a199b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_277a7449-17f7-5d23-a41d-52df33e78d0d/277a7449-17f7-5d23-a41d-52df33e78d0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/0e/750eab36b6dc8324d660af552e0fec9e/pa/EY20513_932a3e0521318af78665c1fa7999a523.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2008}
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [auto1.nl] INFO: Saving data for EY20513: {'created_time': 1774612854.56335, 'last_price_update_time': 1774612854.563361, 'auction_closing_time': 1774717106.0}
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY20513') HTTP/1.1" 204 0
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea1b350>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_2108be6597484e9f0d11ff3b7397652a.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_2108be6597484e9f0d11ff3b7397652a.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:54 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [auto1.nl] INFO: Scrape type for EF55872: 1
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_7484e2b086d33f3359efa2f6e36125f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_7484e2b086d33f3359efa2f6e36125f1.jpg not downloaded yet
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_55cb37acf38129b754e059bb20cc0738.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_55cb37acf38129b754e059bb20cc0738.jpg not downloaded yet
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR93243> (referer: https://www.auto1.com/v1/car-details-view/XR93243/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD24155> (referer: https://www.auto1.com/v1/car-details-view/PD24155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB05434> (referer: https://www.auto1.com/v1/car-details-view/AB05434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US57687> (referer: https://www.auto1.com/v1/car-details-view/US57687/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA65575> (referer: https://www.auto1.com/v1/car-details-view/SA65575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JJ87309> (referer: https://www.auto1.com/v1/car-details-view/JJ87309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_d6aed847840657fcd642a0fd409a17e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_6bfe738eee44c9423c1ffd0de4974470.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_6bfe738eee44c9423c1ffd0de4974470.jpg not downloaded yet
2026-03-27 12:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be151910>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_fde122ff6853146ff943567e7d9414f0.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_fde122ff6853146ff943567e7d9414f0.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be18ed10>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be13bd50>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becdb0d0>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb1dd0>
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg saved to cache
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2775c22c07a4f36c1ec9f19554547d81.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:54 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-27 12:00:54 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [auto1.nl] INFO: Scrape type for TJ45732: 1
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_e9d09cd938a859c040a59cc1edf71322.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_e9d09cd938a859c040a59cc1edf71322.jpg not downloaded yet
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_8a123f5f21cbe2fb01f51536364b112f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_8a123f5f21cbe2fb01f51536364b112f.jpg not downloaded yet
2026-03-27 12:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg not downloaded yet
2026-03-27 12:00:55 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-27 12:00:55 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-27 12:00:55 [auto1.nl] INFO: Found listing with ID: NY57976
2026-03-27 12:00:55 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [auto1.nl] INFO: Scrape type for GA80832: 2
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with scrape type 2
2026-03-27 12:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b28fb79-b976-5d94-ad37-1ad21ed15f92, identifier: GA80832
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_3b41e80896fdb4f519e479870e8e500a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_3b41e80896fdb4f519e479870e8e500a.jpg not downloaded yet
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_b72e816416f0ebf2d387b93186703eaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_b72e816416f0ebf2d387b93186703eaf.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec02c630-8f23-5a6c-8a53-96c910d17780 with identifier: XR93243
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec02c630-8f23-5a6c-8a53-96c910d17780 with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_91ebdfd147fb30c5856912b5ef92117d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_91ebdfd147fb30c5856912b5ef92117d.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_39e7560ee97685cbac95da9d34dba074.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_39e7560ee97685cbac95da9d34dba074.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83e27d-321a-5d90-9779-1e29536a61c2 with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_0a01387c504f3c0784a223f1f81c8c3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_0a01387c504f3c0784a223f1f81c8c3f.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5637948d-a2e9-5b39-afb0-c2999649df09 with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5637948d-a2e9-5b39-afb0-c2999649df09
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_47ac1d0e047a42524ab5c2956b02794c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_47ac1d0e047a42524ab5c2956b02794c.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_b8d582d0d9e81f47fe98ed1043e34940.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_b8d582d0d9e81f47fe98ed1043e34940.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_f47caaffcdc81a0bd593bbf355f1b898.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_f47caaffcdc81a0bd593bbf355f1b898.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_10badda712265492b9e04b8930f5ce23.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_10badda712265492b9e04b8930f5ce23.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_2c1cda05ea9911d736dd1ca53a6a4763.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_2c1cda05ea9911d736dd1ca53a6a4763.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_3fe955cc97d0d205d53f000b4ff569e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_3fe955cc97d0d205d53f000b4ff569e4.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_5a97feb9446d1eabf4fbc13649afe6a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_5a97feb9446d1eabf4fbc13649afe6a5.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_ca0271ab382dddaa1a6fba7f834a1383.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_ca0271ab382dddaa1a6fba7f834a1383.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_9fd175d3b85fe9073368b9c74a2ce51b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_9fd175d3b85fe9073368b9c74a2ce51b.jpg already downloaded
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Fb0%252F1bb0783eee65267ac328124137a5703c%252Fpa%252FSA65575_c8ee83925319743c1fe05a186688624c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_c8ee83925319743c1fe05a186688624c.jpg already downloaded
2026-03-27 12:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5637948d-a2e9-5b39-afb0-c2999649df09, identifier: SA65575
2026-03-27 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-27 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c1213c-d41e-50a7-a447-856ac758f05b with scrape type 1
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_ab7997486e6438f8b71f950c57875132.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_ab7997486e6438f8b71f950c57875132.jpg not downloaded yet
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be13afd0>
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_d6aed847840657fcd642a0fd409a17e0.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_d6aed847840657fcd642a0fd409a17e0.jpg saved to cache
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf33d90>
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg saved to cache
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg not downloaded yet
2026-03-27 12:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-27 12:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832
2026-03-27 12:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b28fb79-b976-5d94-ad37-1ad21ed15f92 with identifier: GA80832 to the API
2026-03-27 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:00:36Z',
 'fuel_type': 'diesel',
 'id': '6b28fb79-b976-5d94-ad37-1ad21ed15f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA80832',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 134652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2016}
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [auto1.nl] INFO: Saving data for GA80832: {'auction_closing_time': 1774713636.0, 'created_time': 1774353842.385482, 'last_price_update_time': 1774612856.16326}
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA80832') HTTP/1.1" 204 0
2026-03-27 12:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575
2026-03-27 12:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5637948d-a2e9-5b39-afb0-c2999649df09 with identifier: SA65575 to the API
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SA65575>
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'hybrid',
 'id': '5637948d-a2e9-5b39-afb0-c2999649df09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'P544TZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA65575',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 145796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_47ac1d0e047a42524ab5c2956b02794c.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_b8d582d0d9e81f47fe98ed1043e34940.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_f47caaffcdc81a0bd593bbf355f1b898.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_10badda712265492b9e04b8930f5ce23.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_2c1cda05ea9911d736dd1ca53a6a4763.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_3fe955cc97d0d205d53f000b4ff569e4.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_5a97feb9446d1eabf4fbc13649afe6a5.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_ca0271ab382dddaa1a6fba7f834a1383.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_9fd175d3b85fe9073368b9c74a2ce51b.jpg',
                'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_c8ee83925319743c1fe05a186688624c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_47ac1d0e047a42524ab5c2956b02794c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_b8d582d0d9e81f47fe98ed1043e34940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_f47caaffcdc81a0bd593bbf355f1b898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_10badda712265492b9e04b8930f5ce23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_2c1cda05ea9911d736dd1ca53a6a4763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_3fe955cc97d0d205d53f000b4ff569e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_5a97feb9446d1eabf4fbc13649afe6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_ca0271ab382dddaa1a6fba7f834a1383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_9fd175d3b85fe9073368b9c74a2ce51b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5637948d-a2e9-5b39-afb0-c2999649df09/5637948d-a2e9-5b39-afb0-c2999649df09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/b0/1bb0783eee65267ac328124137a5703c/pa/SA65575_c8ee83925319743c1fe05a186688624c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [auto1.nl] INFO: Saving data for SA65575: {'created_time': 1774612856.649204, 'last_price_update_time': 1774612856.649216, 'auction_closing_time': 1774714296.0}
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA65575') HTTP/1.1" 204 0
2026-03-27 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_bcdd0af97f313940828871ec22bb5894.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:56 [auto1.nl] INFO: Found listing with ID: DA49617
2026-03-27 12:00:56 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-27 12:00:56 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [auto1.nl] INFO: Scrape type for PG46787: 1
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_885f6eb21d94b704693ea3548153f53d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_885f6eb21d94b704693ea3548153f53d.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_57aa78cb0bf2b9a8731008528bc87447.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_57aa78cb0bf2b9a8731008528bc87447.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_2d6150015137918216abec7b9e1078bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_2d6150015137918216abec7b9e1078bf.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_f6473a5545b08d440c2250057f06d269.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_f6473a5545b08d440c2250057f06d269.jpg not downloaded yet
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg not downloaded yet
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf05f50>
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_2775c22c07a4f36c1ec9f19554547d81.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2775c22c07a4f36c1ec9f19554547d81.jpg saved to cache
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec95050>
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg saved to cache
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_6ade446f509c35e178c54ad1253ffed9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_51eb48ed15eee26906887a413c1e9ee1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:56 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-27 12:00:56 [auto1.nl] INFO: Scrape type for UT08140: 2
2026-03-27 12:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-27 12:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 468f2b31-f3cb-50e4-ba65-71281ebf71ef with scrape type 2
2026-03-27 12:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 468f2b31-f3cb-50e4-ba65-71281ebf71ef with scrape type 2
2026-03-27 12:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 468f2b31-f3cb-50e4-ba65-71281ebf71ef, identifier: UT08140
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_ff275f17183b41432641bbde3feeb0f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_ff275f17183b41432641bbde3feeb0f8.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_68f5639101dda5c492125a92f7ccc811.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_68f5639101dda5c492125a92f7ccc811.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_c689fd1d816a0ce5f16788ad18c48b49.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_c689fd1d816a0ce5f16788ad18c48b49.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg not downloaded yet
2026-03-27 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-27 12:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140
2026-03-27 12:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 468f2b31-f3cb-50e4-ba65-71281ebf71ef with identifier: UT08140 to the API
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:15:31Z',
 'fuel_type': 'petrol',
 'id': '468f2b31-f3cb-50e4-ba65-71281ebf71ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT08140',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 301636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-02',
 'seller_name': None,
 'title': 'Volvo V70 2.4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2005}
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [auto1.nl] INFO: Saving data for UT08140: {'auction_closing_time': 1774714531.0, 'created_time': 1773947235.671376, 'last_price_update_time': 1774612857.504037}
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UT08140') HTTP/1.1" 204 0
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec97290>
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_bcdd0af97f313940828871ec22bb5894.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_bcdd0af97f313940828871ec22bb5894.jpg saved to cache
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea25dd0>
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg saved to cache
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_2f90230f26834b73b38989acbd073914.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:57 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-27 12:00:57 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [auto1.nl] INFO: Scrape type for SD33545: 1
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_0c51c5d796604702b2c1864a01953a87.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_0c51c5d796604702b2c1864a01953a87.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_87eca9b8250bccabfd8143676780d261.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_87eca9b8250bccabfd8143676780d261.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_87f83c980bba0bdb62590e0cea444cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_87f83c980bba0bdb62590e0cea444cef.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_a090b08a6b130f0af97f6b1130d2c92d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_a090b08a6b130f0af97f6b1130d2c92d.jpg not downloaded yet
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg not downloaded yet
2026-03-27 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_ab7997486e6438f8b71f950c57875132.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_6bfe738eee44c9423c1ffd0de4974470.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed5f310>
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg saved to cache
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be038110>
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_6ade446f509c35e178c54ad1253ffed9.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_6ade446f509c35e178c54ad1253ffed9.jpg saved to cache
2026-03-27 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed80210>
2026-03-27 12:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_51eb48ed15eee26906887a413c1e9ee1.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_51eb48ed15eee26906887a413c1e9ee1.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [auto1.nl] INFO: Scrape type for JC35078: 1
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_0ede020d64d649c35329e267b29d087b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_0ede020d64d649c35329e267b29d087b.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_cf26098d1af93fd9e95bd87b1d586503.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_cf26098d1af93fd9e95bd87b1d586503.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg not downloaded yet
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG57021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB92284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_0a01387c504f3c0784a223f1f81c8c3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [auto1.nl] INFO: Scrape type for LX89920: 1
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_a3549db195094eda1e4ba21675735f6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a3549db195094eda1e4ba21675735f6f.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_d81df98e219ff4d90e45674532ba8d76.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_d81df98e219ff4d90e45674532ba8d76.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg not downloaded yet
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf086d0>
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_2f90230f26834b73b38989acbd073914.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_2f90230f26834b73b38989acbd073914.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb97610>
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_ab7997486e6438f8b71f950c57875132.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_ab7997486e6438f8b71f950c57875132.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb6ca90>
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be027410>
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_6bfe738eee44c9423c1ffd0de4974470.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_6bfe738eee44c9423c1ffd0de4974470.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_39e7560ee97685cbac95da9d34dba074.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [auto1.nl] INFO: Scrape type for LY14996: 1
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_a0cd1838c21c7fad339ff004d34793f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a0cd1838c21c7fad339ff004d34793f9.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_14d7b2f7495df3a17507e43f42f9b892.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_14d7b2f7495df3a17507e43f42f9b892.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_6b56af7b364905f1fe7db36323142078.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_6b56af7b364905f1fe7db36323142078.jpg not downloaded yet
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb8f350>
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_0a01387c504f3c0784a223f1f81c8c3f.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_0a01387c504f3c0784a223f1f81c8c3f.jpg saved to cache
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:00:58 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1060 | hits on page: 40
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [auto1.nl] INFO: Scrape type for CX26987: 1
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_3e6701df1156045546f1d04d27e5f105.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_3e6701df1156045546f1d04d27e5f105.jpg not downloaded yet
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_9011985f661396e562e735f725aa2404.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_9011985f661396e562e735f725aa2404.jpg not downloaded yet
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-27 12:00:58 [auto1.nl] INFO: Scrape type for UB57166: 2
2026-03-27 12:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-27 12:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-27 12:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 242474bf-1533-5340-8d9d-3ada2cd998ff with scrape type 2
2026-03-27 12:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 242474bf-1533-5340-8d9d-3ada2cd998ff, identifier: UB57166
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY50584> (referer: https://www.auto1.com/v1/car-details-view/HY50584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_c689fd1d816a0ce5f16788ad18c48b49.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-27 12:00:58 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-27 12:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Scrape type for FU31497: 1
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg not downloaded yet
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_bf11dba3390ca6aac61638abe40a0517.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_bf11dba3390ca6aac61638abe40a0517.jpg not downloaded yet
2026-03-27 12:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-27 12:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166
2026-03-27 12:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 242474bf-1533-5340-8d9d-3ada2cd998ff with identifier: UB57166 to the API
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:56:20Z',
 'fuel_type': 'diesel',
 'id': '242474bf-1533-5340-8d9d-3ada2cd998ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB57166',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 184528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-05',
 'seller_name': None,
 'title': "Kia cee'd 1.4 CRDi Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2013}
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Saving data for UB57166: {'auction_closing_time': 1774716980.0, 'created_time': 1773135283.127139, 'last_price_update_time': 1774612859.36225}
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB57166') HTTP/1.1" 204 0
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf82d90>
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg saved to cache
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beaa5450>
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_39e7560ee97685cbac95da9d34dba074.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_39e7560ee97685cbac95da9d34dba074.jpg saved to cache
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1a8910>
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg saved to cache
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_68f5639101dda5c492125a92f7ccc811.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Scrape type for YU82988: 1
2026-03-27 12:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Scrape type for UC04146: 1
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_75ecde1cb6834ffb83df181b147967bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_75ecde1cb6834ffb83df181b147967bb.jpg not downloaded yet
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_c9c17cfabe63263ba3ea86815c772829.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c9c17cfabe63263ba3ea86815c772829.jpg not downloaded yet
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Scrape type for WD65994: 2
2026-03-27 12:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-27 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7339da98-f9dd-5833-ad9c-585f264bbece with scrape type 2
2026-03-27 12:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7339da98-f9dd-5833-ad9c-585f264bbece, identifier: WD65994
2026-03-27 12:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-27 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 1
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_ca946af13f8d70be3813a02e092983cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_ca946af13f8d70be3813a02e092983cf.jpg not downloaded yet
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be12bb90>
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_c689fd1d816a0ce5f16788ad18c48b49.jpg') HTTP/1.1" 204 0
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_c689fd1d816a0ce5f16788ad18c48b49.jpg saved to cache
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-27 12:00:59 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-27 12:00:59 [auto1.nl] INFO: Scrape type for UB37816: 2
2026-03-27 12:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-27 12:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b490cb09-3e3c-54bf-b8a4-06e5a114cddf with scrape type 2
2026-03-27 12:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b490cb09-3e3c-54bf-b8a4-06e5a114cddf with scrape type 2
2026-03-27 12:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b490cb09-3e3c-54bf-b8a4-06e5a114cddf, identifier: UB37816
2026-03-27 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-27 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994
2026-03-27 12:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7339da98-f9dd-5833-ad9c-585f264bbece with identifier: WD65994 to the API
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:31Z',
 'fuel_type': 'petrol',
 'id': '7339da98-f9dd-5833-ad9c-585f264bbece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD65994',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 263960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-27 12:01:00 [auto1.nl] INFO: Saving data for WD65994: {'auction_closing_time': 1774716091.0, 'created_time': 1773836967.795693, 'last_price_update_time': 1774612860.441161}
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WD65994') HTTP/1.1" 204 0
2026-03-27 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a902338e00f05e81b6c2916ede5601e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_cf26098d1af93fd9e95bd87b1d586503.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-27 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816
2026-03-27 12:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b490cb09-3e3c-54bf-b8a4-06e5a114cddf with identifier: UB37816 to the API
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:10:54Z',
 'fuel_type': 'petrol',
 'id': 'b490cb09-3e3c-54bf-b8a4-06e5a114cddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB37816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 162613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-27 12:01:00 [auto1.nl] INFO: Saving data for UB37816: {'auction_closing_time': 1774714254.0, 'created_time': 1773775073.019735, 'last_price_update_time': 1774612860.783375}
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB37816') HTTP/1.1" 204 0
2026-03-27 12:01:00 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-27 12:01:00 [auto1.nl] INFO: Scrape type for GS47094: 2
2026-03-27 12:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-27 12:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-27 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 224473c8-ce88-5d83-939f-aac48135da14 with scrape type 2
2026-03-27 12:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 224473c8-ce88-5d83-939f-aac48135da14, identifier: GS47094
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg not downloaded yet
2026-03-27 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_0ede020d64d649c35329e267b29d087b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:00 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-27 12:01:00 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-27 12:01:00 [auto1.nl] INFO: Scrape type for GX38555: 1
2026-03-27 12:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-27 12:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094
2026-03-27 12:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 224473c8-ce88-5d83-939f-aac48135da14 with identifier: GS47094 to the API
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:50Z',
 'fuel_type': 'petrol',
 'id': '224473c8-ce88-5d83-939f-aac48135da14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS47094',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 104966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-27 12:01:01 [auto1.nl] INFO: Saving data for GS47094: {'auction_closing_time': 1774716650.0, 'created_time': 1773688145.394938, 'last_price_update_time': 1774612861.338252}
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS47094') HTTP/1.1" 204 0
2026-03-27 12:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-27 12:01:01 [auto1.nl] INFO: Scrape type for LH66044: 2
2026-03-27 12:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-27 12:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 403fad5d-d905-5b73-babd-73a4fc03a4b2 with scrape type 2
2026-03-27 12:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 403fad5d-d905-5b73-babd-73a4fc03a4b2, identifier: LH66044
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_7d287a600298960536796bc16f63f5d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_7d287a600298960536796bc16f63f5d9.jpg not downloaded yet
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea30790>
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_68f5639101dda5c492125a92f7ccc811.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_68f5639101dda5c492125a92f7ccc811.jpg saved to cache
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4d07410>
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg saved to cache
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be06eed0>
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg saved to cache
2026-03-27 12:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-27 12:01:01 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-27 12:01:01 [auto1.nl] INFO: Scrape type for RN50601: 1
2026-03-27 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 12:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044
2026-03-27 12:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 403fad5d-d905-5b73-babd-73a4fc03a4b2 with identifier: LH66044 to the API
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'diesel',
 'id': '403fad5d-d905-5b73-babd-73a4fc03a4b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH66044',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 280431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D3 Linje Classic',
 'transmission': 'manual',
 'trim': 'Linje Classic',
 'year': 2015}
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-27 12:01:02 [auto1.nl] INFO: Saving data for LH66044: {'auction_closing_time': 1774714749.0, 'created_time': 1773514831.760093, 'last_price_update_time': 1774612862.265641}
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH66044') HTTP/1.1" 204 0
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC35078/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_3e6701df1156045546f1d04d27e5f105.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-27 12:01:02 [auto1.nl] INFO: Scrape type for XA85497: 2
2026-03-27 12:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-27 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 105ffac9-32f7-5baf-a4dc-41031fe00db7 with scrape type 2
2026-03-27 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 105ffac9-32f7-5baf-a4dc-41031fe00db7, identifier: XA85497
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_28e72093ac06c78db3935067c1ec4193.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_28e72093ac06c78db3935067c1ec4193.jpg not downloaded yet
2026-03-27 12:01:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0b43d0>
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_a902338e00f05e81b6c2916ede5601e3.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a902338e00f05e81b6c2916ede5601e3.jpg saved to cache
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beacc0d0>
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_cf26098d1af93fd9e95bd87b1d586503.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_cf26098d1af93fd9e95bd87b1d586503.jpg saved to cache
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebb70d0>
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg saved to cache
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be06a3d0>
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg saved to cache
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beca9e90>
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_0ede020d64d649c35329e267b29d087b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_0ede020d64d649c35329e267b29d087b.jpg saved to cache
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_9011985f661396e562e735f725aa2404.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:02 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-27 12:01:02 [auto1.nl] INFO: Scrape type for XJ87481: 2
2026-03-27 12:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-27 12:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-27 12:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028a42f1-9ffa-50d6-a30b-fed070358151 with scrape type 2
2026-03-27 12:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 028a42f1-9ffa-50d6-a30b-fed070358151, identifier: XJ87481
2026-03-27 12:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-27 12:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497
2026-03-27 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 105ffac9-32f7-5baf-a4dc-41031fe00db7 with identifier: XA85497 to the API
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:31:59Z',
 'fuel_type': 'diesel',
 'id': '105ffac9-32f7-5baf-a4dc-41031fe00db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA85497',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 280658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Business 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Business 2WD',
 'year': 2015}
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-27 12:01:03 [auto1.nl] INFO: Saving data for XA85497: {'auction_closing_time': 1774715519.0, 'created_time': 1773135052.806749, 'last_price_update_time': 1774612863.291338}
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XA85497') HTTP/1.1" 204 0
2026-03-27 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-27 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481
2026-03-27 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 028a42f1-9ffa-50d6-a30b-fed070358151 with identifier: XJ87481 to the API
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:18:59Z',
 'fuel_type': 'petrol',
 'id': '028a42f1-9ffa-50d6-a30b-fed070358151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ87481',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 86841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2020}
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-27 12:01:03 [auto1.nl] INFO: Saving data for XJ87481: {'auction_closing_time': 1774714739.0, 'created_time': 1773132399.825246, 'last_price_update_time': 1774612863.640054}
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ87481') HTTP/1.1" 204 0
2026-03-27 12:01:03 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-27 12:01:03 [auto1.nl] INFO: Scrape type for CG77801: 2
2026-03-27 12:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-27 12:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-27 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12a5345-0774-5d5d-8419-10744b816bf5 with scrape type 2
2026-03-27 12:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d12a5345-0774-5d5d-8419-10744b816bf5, identifier: CG77801
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg not downloaded yet
2026-03-27 12:01:03 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-27 12:01:03 [auto1.nl] INFO: Scrape type for NL71418: 1
2026-03-27 12:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-27 12:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801
2026-03-27 12:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d12a5345-0774-5d5d-8419-10744b816bf5 with identifier: CG77801 to the API
2026-03-27 12:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:20Z',
 'fuel_type': 'diesel',
 'id': 'd12a5345-0774-5d5d-8419-10744b816bf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG77801',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 214505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-20',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.3 Diesel LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-27 12:01:04 [auto1.nl] INFO: Saving data for CG77801: {'auction_closing_time': 1774715240.0, 'created_time': 1773134959.801317, 'last_price_update_time': 1774612864.162816}
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG77801') HTTP/1.1" 204 0
2026-03-27 12:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be053a10>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1b8b90>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_3e6701df1156045546f1d04d27e5f105.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_3e6701df1156045546f1d04d27e5f105.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb3fc90>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1b9f10>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_ca946af13f8d70be3813a02e092983cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c9c17cfabe63263ba3ea86815c772829.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-27 12:01:04 [auto1.nl] INFO: Scrape type for PP29341: 2
2026-03-27 12:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-27 12:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with scrape type 2
2026-03-27 12:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e63cf1c0-3b16-5c7a-a8b5-88546cd74822, identifier: PP29341
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_1463b139f834f8e3bf0299ee341272d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_1463b139f834f8e3bf0299ee341272d5.jpg not downloaded yet
2026-03-27 12:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebc9290>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedaf390>
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_9011985f661396e562e735f725aa2404.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_9011985f661396e562e735f725aa2404.jpg saved to cache
2026-03-27 12:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:04 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-27 12:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-27 12:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341
2026-03-27 12:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e63cf1c0-3b16-5c7a-a8b5-88546cd74822 with identifier: PP29341 to the API
2026-03-27 12:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'petrol',
 'id': 'e63cf1c0-3b16-5c7a-a8b5-88546cd74822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP29341',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 182562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-23',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2005}
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [auto1.nl] INFO: Saving data for PP29341: {'auction_closing_time': 1774714816.0, 'created_time': 1774094520.819926, 'last_price_update_time': 1774612865.16822}
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP29341') HTTP/1.1" 204 0
2026-03-27 12:01:05 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-27 12:01:05 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-27 12:01:05 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [auto1.nl] INFO: Scrape type for WR76222: 2
2026-03-27 12:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-27 12:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36efc695-9723-5bbd-905a-b337eba2b624 with scrape type 2
2026-03-27 12:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36efc695-9723-5bbd-905a-b337eba2b624, identifier: WR76222
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg not downloaded yet
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX26987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_28e72093ac06c78db3935067c1ec4193.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-27 12:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222
2026-03-27 12:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36efc695-9723-5bbd-905a-b337eba2b624 with identifier: WR76222 to the API
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:02:10Z',
 'fuel_type': 'hybrid',
 'id': '36efc695-9723-5bbd-905a-b337eba2b624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR76222',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 246899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [auto1.nl] INFO: Saving data for WR76222: {'auction_closing_time': 1774713730.0, 'created_time': 1773231502.89427, 'last_price_update_time': 1774612865.646892}
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR76222') HTTP/1.1" 204 0
2026-03-27 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_a30a41a73466ead3b58266a401eaf984.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_bf11dba3390ca6aac61638abe40a0517.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_7d287a600298960536796bc16f63f5d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:05 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [auto1.nl] INFO: Scrape type for ME73088: 1
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e631efef6f036667bbd99657b4fc8489.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e631efef6f036667bbd99657b4fc8489.jpg not downloaded yet
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be18ced0>
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_ca946af13f8d70be3813a02e092983cf.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_ca946af13f8d70be3813a02e092983cf.jpg saved to cache
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0b80d0>
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_c9c17cfabe63263ba3ea86815c772829.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c9c17cfabe63263ba3ea86815c772829.jpg saved to cache
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:05 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [auto1.nl] INFO: Scrape type for UJ24113: 2
2026-03-27 12:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-27 12:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with scrape type 2
2026-03-27 12:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d, identifier: UJ24113
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e3be211f5dcdf521fa27030a16278f58.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e3be211f5dcdf521fa27030a16278f58.jpg not downloaded yet
2026-03-27 12:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-27 12:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113
2026-03-27 12:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f8ba5787-5f2e-51ae-a90f-2f4e2a08607d with identifier: UJ24113 to the API
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:38:38Z',
 'fuel_type': 'petrol',
 'id': 'f8ba5787-5f2e-51ae-a90f-2f4e2a08607d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ24113',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 69078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-27 12:01:06 [auto1.nl] INFO: Saving data for UJ24113: {'auction_closing_time': 1774715918.0, 'created_time': 1774267367.165865, 'last_price_update_time': 1774612866.294156}
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ24113') HTTP/1.1" 204 0
2026-03-27 12:01:06 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1060 | hits on page: 40
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be090dd0>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be181fd0>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_28e72093ac06c78db3935067c1ec4193.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_28e72093ac06c78db3935067c1ec4193.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be087990>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_a30a41a73466ead3b58266a401eaf984.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_a30a41a73466ead3b58266a401eaf984.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea2c810>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_bf11dba3390ca6aac61638abe40a0517.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_bf11dba3390ca6aac61638abe40a0517.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb0dd0>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec36950>
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_7d287a600298960536796bc16f63f5d9.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_7d287a600298960536796bc16f63f5d9.jpg saved to cache
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_14d7b2f7495df3a17507e43f42f9b892.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:06 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-27 12:01:06 [auto1.nl] INFO: Scrape type for BC03068: 2
2026-03-27 12:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-27 12:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4657347b-0760-5e83-b9da-2506de5a3f41 with scrape type 2
2026-03-27 12:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4657347b-0760-5e83-b9da-2506de5a3f41, identifier: BC03068
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg not downloaded yet
2026-03-27 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_6b56af7b364905f1fe7db36323142078.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-27 12:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068
2026-03-27 12:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4657347b-0760-5e83-b9da-2506de5a3f41 with identifier: BC03068 to the API
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-28T16:22:34Z',
 'fuel_type': 'petrol',
 'id': '4657347b-0760-5e83-b9da-2506de5a3f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03068',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 120866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Si4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-27 12:01:07 [auto1.nl] INFO: Saving data for BC03068: {'auction_closing_time': 1774714954.0, 'created_time': 1773342622.085241, 'last_price_update_time': 1774612867.285531}
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC03068') HTTP/1.1" 204 0
2026-03-27 12:01:07 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-27 12:01:07 [auto1.nl] INFO: Scrape type for HT40495: 2
2026-03-27 12:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-27 12:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-27 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da3445bc-a86e-5c98-bdcd-d53d95056772 with scrape type 2
2026-03-27 12:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: da3445bc-a86e-5c98-bdcd-d53d95056772, identifier: HT40495
2026-03-27 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC04146/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_1463b139f834f8e3bf0299ee341272d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:07 [scrapy.extensions.logstats] INFO: Crawled 51 pages (at 51 pages/min), scraped 22 items (at 22 items/min)
2026-03-27 12:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-27 12:01:07 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-27 12:01:07 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-27 12:01:07 [auto1.nl] INFO: Scrape type for YN14337: 2
2026-03-27 12:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-27 12:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-27 12:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb566f2-7ec2-5de5-8b5f-2d829148d758 with scrape type 2
2026-03-27 12:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ffb566f2-7ec2-5de5-8b5f-2d829148d758, identifier: YN14337
2026-03-27 12:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-27 12:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495
2026-03-27 12:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: da3445bc-a86e-5c98-bdcd-d53d95056772 with identifier: HT40495 to the API
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:46Z',
 'fuel_type': 'petrol',
 'id': 'da3445bc-a86e-5c98-bdcd-d53d95056772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT40495',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 199743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-27 12:01:07 [auto1.nl] INFO: Saving data for HT40495: {'auction_closing_time': 1774713766.0, 'created_time': 1773861110.385504, 'last_price_update_time': 1774612867.90273}
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT40495') HTTP/1.1" 204 0
2026-03-27 12:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU82988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-27 12:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337
2026-03-27 12:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ffb566f2-7ec2-5de5-8b5f-2d829148d758 with identifier: YN14337 to the API
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': 'ffb566f2-7ec2-5de5-8b5f-2d829148d758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN14337',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 187042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-27 12:01:08 [auto1.nl] INFO: Saving data for YN14337: {'auction_closing_time': 1774716540.0, 'created_time': 1773134922.681851, 'last_price_update_time': 1774612868.463895}
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN14337') HTTP/1.1" 204 0
2026-03-27 12:01:08 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-27 12:01:08 [auto1.nl] INFO: Scrape type for WZ36257: 2
2026-03-27 12:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-27 12:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-27 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with scrape type 2
2026-03-27 12:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28ba592c-7ac3-5729-9be0-10f3ce0989b3, identifier: WZ36257
2026-03-27 12:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3d2b2fd50>
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg saved to cache
2026-03-27 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be094dd0>
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_14d7b2f7495df3a17507e43f42f9b892.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_14d7b2f7495df3a17507e43f42f9b892.jpg saved to cache
2026-03-27 12:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e631efef6f036667bbd99657b4fc8489.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:08 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-27 12:01:08 [auto1.nl] INFO: Scrape type for VM29173: 1
2026-03-27 12:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-27 12:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257
2026-03-27 12:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28ba592c-7ac3-5729-9be0-10f3ce0989b3 with identifier: WZ36257 to the API
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:24:32Z',
 'fuel_type': 'petrol',
 'id': '28ba592c-7ac3-5729-9be0-10f3ce0989b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ36257',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 259254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-27 12:01:09 [auto1.nl] INFO: Saving data for WZ36257: {'auction_closing_time': 1774715072.0, 'created_time': 1773133835.683907, 'last_price_update_time': 1774612869.098629}
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ36257') HTTP/1.1" 204 0
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebe4a10>
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg saved to cache
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec53e10>
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_6b56af7b364905f1fe7db36323142078.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_6b56af7b364905f1fe7db36323142078.jpg saved to cache
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e3be211f5dcdf521fa27030a16278f58.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:09 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-27 12:01:09 [auto1.nl] INFO: Scrape type for CY67010: 2
2026-03-27 12:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-27 12:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 626b999f-1528-580b-b99b-228af78dc2b6 with scrape type 2
2026-03-27 12:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 626b999f-1528-580b-b99b-228af78dc2b6, identifier: CY67010
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be097950>
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_1463b139f834f8e3bf0299ee341272d5.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_1463b139f834f8e3bf0299ee341272d5.jpg saved to cache
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:09 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-27 12:01:09 [auto1.nl] INFO: Scrape type for RR80165: 2
2026-03-27 12:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-27 12:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6456eb-d795-5df0-9111-f24d5434d664 with scrape type 2
2026-03-27 12:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6456eb-d795-5df0-9111-f24d5434d664 with scrape type 2
2026-03-27 12:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0d6456eb-d795-5df0-9111-f24d5434d664, identifier: RR80165
2026-03-27 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-27 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010
2026-03-27 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 626b999f-1528-580b-b99b-228af78dc2b6 with identifier: CY67010 to the API
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:06:57Z',
 'fuel_type': 'petrol',
 'id': '626b999f-1528-580b-b99b-228af78dc2b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY67010',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 241219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Volvo V70 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-27 12:01:09 [auto1.nl] INFO: Saving data for CY67010: {'auction_closing_time': 1774714017.0, 'created_time': 1773687672.755652, 'last_price_update_time': 1774612869.791203}
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY67010') HTTP/1.1" 204 0
2026-03-27 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL71418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC35078> (referer: https://www.auto1.com/v1/car-details-view/JC35078/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB92284> (referer: https://www.auto1.com/v1/car-details-view/AB92284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-27 12:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165
2026-03-27 12:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0d6456eb-d795-5df0-9111-f24d5434d664 with identifier: RR80165 to the API
2026-03-27 12:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:11:05Z',
 'fuel_type': 'petrol',
 'id': '0d6456eb-d795-5df0-9111-f24d5434d664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR80165',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 157384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-22',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S Sidewalk',
 'transmission': 'automatic',
 'trim': 'Sidewalk',
 'year': 2008}
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-27 12:01:10 [auto1.nl] INFO: Saving data for RR80165: {'auction_closing_time': 1774714265.0, 'created_time': 1773229343.79814, 'last_price_update_time': 1774612870.183024}
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RR80165') HTTP/1.1" 204 0
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-27 12:01:10 [auto1.nl] INFO: Scrape type for XJ71773: 2
2026-03-27 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-27 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-27 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587b4062-1786-5f79-aafa-869288bf6b45 with scrape type 2
2026-03-27 12:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 587b4062-1786-5f79-aafa-869288bf6b45, identifier: XJ71773
2026-03-27 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed985d0>
2026-03-27 12:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e631efef6f036667bbd99657b4fc8489.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e631efef6f036667bbd99657b4fc8489.jpg saved to cache
2026-03-27 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_55cb37acf38129b754e059bb20cc0738.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a0cd1838c21c7fad339ff004d34793f9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-27 12:01:10 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-27 12:01:10 [auto1.nl] INFO: Scrape type for FB46775: 2
2026-03-27 12:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-27 12:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-27 12:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with scrape type 2
2026-03-27 12:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a680d4a3-dea7-5c80-9818-7e0b3b2ed048, identifier: FB46775
2026-03-27 12:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-27 12:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773
2026-03-27 12:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 587b4062-1786-5f79-aafa-869288bf6b45 with identifier: XJ71773 to the API
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:20:32Z',
 'fuel_type': 'petrol',
 'id': '587b4062-1786-5f79-aafa-869288bf6b45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ71773',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 87103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'BMW 4er 420i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-27 12:01:10 [auto1.nl] INFO: Saving data for XJ71773: {'auction_closing_time': 1774714832.0, 'created_time': 1774267370.469334, 'last_price_update_time': 1774612870.89597}
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ71773') HTTP/1.1" 204 0
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea2c910>
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_e3be211f5dcdf521fa27030a16278f58.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e3be211f5dcdf521fa27030a16278f58.jpg saved to cache
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-27 12:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775
2026-03-27 12:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a680d4a3-dea7-5c80-9818-7e0b3b2ed048 with identifier: FB46775 to the API
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:54:44Z',
 'fuel_type': 'hybrid',
 'id': 'a680d4a3-dea7-5c80-9818-7e0b3b2ed048',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB46775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 44926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-27 12:01:11 [auto1.nl] INFO: Saving data for FB46775: {'auction_closing_time': 1774716884.0, 'created_time': 1774292591.856896, 'last_price_update_time': 1774612871.431013}
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB46775') HTTP/1.1" 204 0
2026-03-27 12:01:11 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-27 12:01:11 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-27 12:01:11 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-27 12:01:11 [auto1.nl] INFO: Scrape type for CC90793: 2
2026-03-27 12:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-27 12:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c95ce620-8b77-59ba-8269-2f4c78b76f63 with scrape type 2
2026-03-27 12:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c95ce620-8b77-59ba-8269-2f4c78b76f63, identifier: CC90793
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea80490>
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fdd%252F40ddc2e599d65431de11bad0c476856e%252Fpa%252FHY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg saved to cache
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed
2026-03-27 12:01:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed, skipping ID generation
2026-03-27 12:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with scrape type 1
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed sending to next pipeline
2026-03-27 12:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed, identifier: HY50584
2026-03-27 12:01:11 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-27 12:01:11 [auto1.nl] INFO: Scrape type for LG18300: 2
2026-03-27 12:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-27 12:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-27 12:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 916443fa-fa92-5806-9155-9fc77689165c with scrape type 2
2026-03-27 12:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 916443fa-fa92-5806-9155-9fc77689165c, identifier: LG18300
2026-03-27 12:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-27 12:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793
2026-03-27 12:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c95ce620-8b77-59ba-8269-2f4c78b76f63 with identifier: CC90793 to the API
2026-03-27 12:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:15:08Z',
 'fuel_type': 'petrol',
 'id': 'c95ce620-8b77-59ba-8269-2f4c78b76f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC90793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 204594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-02',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [auto1.nl] INFO: Saving data for CC90793: {'auction_closing_time': 1774714508.0, 'created_time': 1774119698.454132, 'last_price_update_time': 1774612872.136043}
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CC90793') HTTP/1.1" 204 0
2026-03-27 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN50601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU31497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-27 12:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584
2026-03-27 12:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed with identifier: HY50584 to the API
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:54:41Z',
 'fuel_type': 'hybrid',
 'id': 'a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TR127H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY50584',
 'listing': 'auction',
 'location': "NL, 's-Gravenzande",
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 129771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_ca946af13f8d70be3813a02e092983cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_54e51a806aa1ee4cb40dfe65a2726b9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_7d287a600298960536796bc16f63f5d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_28e72093ac06c78db3935067c1ec4193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e7964bb20cd3b2bb3359d7fe10b977ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_1463b139f834f8e3bf0299ee341272d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_998ac231ed2784b3f4cfce4ef44842a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e631efef6f036667bbd99657b4fc8489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_e3be211f5dcdf521fa27030a16278f58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed/a7e59c3a-7e28-55fb-8fc5-1dc03b8794ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/dd/40ddc2e599d65431de11bad0c476856e/pa/HY50584_19a711df0d8cacb8593960cd8e4b21ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Flow',
 'transmission': 'automatic',
 'trim': 'Flow',
 'year': 2017}
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [auto1.nl] INFO: Saving data for HY50584: {'created_time': 1774612872.583904, 'last_price_update_time': 1774612872.583918, 'auction_closing_time': 1774716881.0}
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY50584') HTTP/1.1" 204 0
2026-03-27 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-27 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with scrape type 1
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83c358ee-d5b0-5bbc-8153-04a51ec4c1af
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_d8e0575781b88e29091ce58ca1b246f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d8e0575781b88e29091ce58ca1b246f0.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_9c81ec66f7e06e25645136502629f41f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9c81ec66f7e06e25645136502629f41f.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_f43c60b480f726f5f6091148b0ebc95a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_f43c60b480f726f5f6091148b0ebc95a.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_bdbd22a175dc9961a3930b122830b68c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bdbd22a175dc9961a3930b122830b68c.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_15406549dd91b251c3076cafead62466.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_15406549dd91b251c3076cafead62466.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_d95de7ce5aaf998240f00fe8c16a9e05.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d95de7ce5aaf998240f00fe8c16a9e05.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_bd849238f0ca762bb80da18bcf09b7f9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bd849238f0ca762bb80da18bcf09b7f9.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_b4693c295e666d9d3f7a44457ed66afa.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_b4693c295e666d9d3f7a44457ed66afa.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_36ac3513584047164af37aac79d430be.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_36ac3513584047164af37aac79d430be.jpg already downloaded
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F03%252F98037c762123ee0104bc97586751a84f%252Fpa%252FJC35078_9dc086f06a2dee06f4800ce37a70afe4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9dc086f06a2dee06f4800ce37a70afe4.jpg already downloaded
2026-03-27 12:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af, identifier: JC35078
2026-03-27 12:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a731edc4-4823-5ae3-96c0-2c82d02c85fd with identifier: AB92284
2026-03-27 12:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a731edc4-4823-5ae3-96c0-2c82d02c85fd with scrape type 1
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_4b9571e31674a2b73ccd6e4566573589.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_4b9571e31674a2b73ccd6e4566573589.jpg not downloaded yet
2026-03-27 12:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-27 12:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300
2026-03-27 12:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 916443fa-fa92-5806-9155-9fc77689165c with identifier: LG18300 to the API
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:04Z',
 'fuel_type': 'petrol',
 'id': '916443fa-fa92-5806-9155-9fc77689165c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG18300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 212035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-27 12:01:13 [auto1.nl] INFO: Saving data for LG18300: {'auction_closing_time': 1774714504.0, 'created_time': 1773688236.711237, 'last_price_update_time': 1774612873.76167}
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG18300') HTTP/1.1" 204 0
2026-03-27 12:01:13 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-27 12:01:13 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-27 12:01:13 [auto1.nl] INFO: Scrape type for FY76730: 2
2026-03-27 12:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-27 12:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-27 12:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with scrape type 2
2026-03-27 12:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77c6191a-39c6-55cc-8e1b-5ef67fad3537, identifier: FY76730
2026-03-27 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX38555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-27 12:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078
2026-03-27 12:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83c358ee-d5b0-5bbc-8153-04a51ec4c1af with identifier: JC35078 to the API
2026-03-27 12:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC35078>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:35:53Z',
 'fuel_type': 'petrol',
 'id': '83c358ee-d5b0-5bbc-8153-04a51ec4c1af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P396ZG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC35078',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 135975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d8e0575781b88e29091ce58ca1b246f0.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9c81ec66f7e06e25645136502629f41f.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_f43c60b480f726f5f6091148b0ebc95a.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bdbd22a175dc9961a3930b122830b68c.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_15406549dd91b251c3076cafead62466.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d95de7ce5aaf998240f00fe8c16a9e05.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bd849238f0ca762bb80da18bcf09b7f9.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_b4693c295e666d9d3f7a44457ed66afa.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_36ac3513584047164af37aac79d430be.jpg',
                'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9dc086f06a2dee06f4800ce37a70afe4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429408,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d8e0575781b88e29091ce58ca1b246f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2460786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9c81ec66f7e06e25645136502629f41f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_f43c60b480f726f5f6091148b0ebc95a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bdbd22a175dc9961a3930b122830b68c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_15406549dd91b251c3076cafead62466.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_d95de7ce5aaf998240f00fe8c16a9e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_bd849238f0ca762bb80da18bcf09b7f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_b4693c295e666d9d3f7a44457ed66afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_36ac3513584047164af37aac79d430be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83c358ee-d5b0-5bbc-8153-04a51ec4c1af/83c358ee-d5b0-5bbc-8153-04a51ec4c1af_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/03/98037c762123ee0104bc97586751a84f/pa/JC35078_9dc086f06a2dee06f4800ce37a70afe4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2015}
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-27 12:01:15 [auto1.nl] INFO: Saving data for JC35078: {'created_time': 1774612875.200698, 'last_price_update_time': 1774612875.200709, 'auction_closing_time': 1774715753.0}
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC35078') HTTP/1.1" 204 0
2026-03-27 12:01:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0a9a10>
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_55cb37acf38129b754e059bb20cc0738.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_55cb37acf38129b754e059bb20cc0738.jpg saved to cache
2026-03-27 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0103d0>
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_a0cd1838c21c7fad339ff004d34793f9.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a0cd1838c21c7fad339ff004d34793f9.jpg saved to cache
2026-03-27 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:15 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-27 12:01:15 [auto1.nl] INFO: Scrape type for FX92385: 2
2026-03-27 12:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-27 12:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c5baad-2743-54f1-b22a-83e60a7b3e8c with scrape type 2
2026-03-27 12:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c5baad-2743-54f1-b22a-83e60a7b3e8c with scrape type 2
2026-03-27 12:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06c5baad-2743-54f1-b22a-83e60a7b3e8c, identifier: FX92385
2026-03-27 12:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-27 12:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730
2026-03-27 12:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77c6191a-39c6-55cc-8e1b-5ef67fad3537 with identifier: FY76730 to the API
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'diesel',
 'id': '77c6191a-39c6-55cc-8e1b-5ef67fad3537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY76730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 249210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-27 12:01:16 [auto1.nl] INFO: Saving data for FY76730: {'auction_closing_time': 1774716608.0, 'created_time': 1773131923.538821, 'last_price_update_time': 1774612876.05255}
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FY76730') HTTP/1.1" 204 0
2026-03-27 12:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg not downloaded yet
2026-03-27 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG57021> (referer: https://www.auto1.com/v1/car-details-view/LG57021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed5a610>
2026-03-27 12:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg saved to cache
2026-03-27 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_d81df98e219ff4d90e45674532ba8d76.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a3549db195094eda1e4ba21675735f6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-27 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385
2026-03-27 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06c5baad-2743-54f1-b22a-83e60a7b3e8c with identifier: FX92385 to the API
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:21:48Z',
 'fuel_type': 'petrol',
 'id': '06c5baad-2743-54f1-b22a-83e60a7b3e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX92385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 90840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-27 12:01:16 [auto1.nl] INFO: Saving data for FX92385: {'auction_closing_time': 1774714908.0, 'created_time': 1773134253.452387, 'last_price_update_time': 1774612876.526319}
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FX92385') HTTP/1.1" 204 0
2026-03-27 12:01:16 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-27 12:01:16 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-27 12:01:16 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-27 12:01:16 [auto1.nl] INFO: Scrape type for SL12489: 2
2026-03-27 12:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-27 12:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-27 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 089b05a9-5f33-5c13-ad69-689086c457da with scrape type 2
2026-03-27 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 089b05a9-5f33-5c13-ad69-689086c457da, identifier: SL12489
2026-03-27 12:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX26987> (referer: https://www.auto1.com/v1/car-details-view/CX26987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:16 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-27 12:01:16 [auto1.nl] INFO: Scrape type for JA96094: 2
2026-03-27 12:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-27 12:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-27 12:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f998d16-defa-5ffb-9e97-14c2372f574d with scrape type 2
2026-03-27 12:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f998d16-defa-5ffb-9e97-14c2372f574d, identifier: JA96094
2026-03-27 12:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-27 12:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489
2026-03-27 12:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 089b05a9-5f33-5c13-ad69-689086c457da with identifier: SL12489 to the API
2026-03-27 12:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:09:34Z',
 'fuel_type': 'hybrid',
 'id': '089b05a9-5f33-5c13-ad69-689086c457da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL12489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 111869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-27 12:01:17 [auto1.nl] INFO: Saving data for SL12489: {'auction_closing_time': 1774714174.0, 'created_time': 1773688329.132838, 'last_price_update_time': 1774612877.145293}
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL12489') HTTP/1.1" 204 0
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg not downloaded yet
2026-03-27 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-27 12:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094
2026-03-27 12:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f998d16-defa-5ffb-9e97-14c2372f574d with identifier: JA96094 to the API
2026-03-27 12:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:12:56Z',
 'fuel_type': 'petrol',
 'id': '9f998d16-defa-5ffb-9e97-14c2372f574d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA96094',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 263681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-27 12:01:18 [auto1.nl] INFO: Saving data for JA96094: {'auction_closing_time': 1774714376.0, 'created_time': 1774094522.883026, 'last_price_update_time': 1774612878.246321}
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA96094') HTTP/1.1" 204 0
2026-03-27 12:01:18 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-27 12:01:18 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-27 12:01:18 [auto1.nl] INFO: Scrape type for LJ95506: 2
2026-03-27 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-27 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with scrape type 2
2026-03-27 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with scrape type 2
2026-03-27 12:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3, identifier: LJ95506
2026-03-27 12:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb6fbd0>
2026-03-27 12:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg saved to cache
2026-03-27 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:18 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-27 12:01:18 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-27 12:01:18 [auto1.nl] INFO: Scrape type for XV01386: 2
2026-03-27 12:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-27 12:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-27 12:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with scrape type 2
2026-03-27 12:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 584ceb9e-5605-5102-b1d0-e5ade31e20e9, identifier: XV01386
2026-03-27 12:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-27 12:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506
2026-03-27 12:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da47a34-cfe8-5c2b-aa45-be8ec079c8b3 with identifier: LJ95506 to the API
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:28:51Z',
 'fuel_type': 'petrol',
 'id': '4da47a34-cfe8-5c2b-aa45-be8ec079c8b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ95506',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 246282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-28',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [auto1.nl] INFO: Saving data for LJ95506: {'auction_closing_time': 1774715331.0, 'created_time': 1774094456.324889, 'last_price_update_time': 1774612879.012581}
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LJ95506') HTTP/1.1" 204 0
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_1d90ffbc42f8742952397168a5cabc82.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1d90ffbc42f8742952397168a5cabc82.jpg not downloaded yet
2026-03-27 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-27 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 1
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_09c45728983429338c36bc1c6854e67b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_09c45728983429338c36bc1c6854e67b.jpg not downloaded yet
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb1dbd0>
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_d81df98e219ff4d90e45674532ba8d76.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_d81df98e219ff4d90e45674532ba8d76.jpg saved to cache
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4e3e550>
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_a3549db195094eda1e4ba21675735f6f.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a3549db195094eda1e4ba21675735f6f.jpg saved to cache
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_87f83c980bba0bdb62590e0cea444cef.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_4b9571e31674a2b73ccd6e4566573589.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-27 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386
2026-03-27 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 584ceb9e-5605-5102-b1d0-e5ade31e20e9 with identifier: XV01386 to the API
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:42:57Z',
 'fuel_type': 'petrol',
 'id': '584ceb9e-5605-5102-b1d0-e5ade31e20e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV01386',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 79518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [auto1.nl] INFO: Saving data for XV01386: {'auction_closing_time': 1774716177.0, 'created_time': 1773774209.302946, 'last_price_update_time': 1774612879.491225}
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV01386') HTTP/1.1" 204 0
2026-03-27 12:01:19 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [auto1.nl] INFO: Scrape type for CR43638: 2
2026-03-27 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-27 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa788e2c-e5db-583a-9086-06980bff4626 with scrape type 2
2026-03-27 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa788e2c-e5db-583a-9086-06980bff4626, identifier: CR43638
2026-03-27 12:01:19 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-27 12:01:19 [auto1.nl] INFO: Scrape type for DH84557: 2
2026-03-27 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-27 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with scrape type 2
2026-03-27 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with scrape type 2
2026-03-27 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ae2506ce-9cca-5295-a0b0-d9ad8efa4626, identifier: DH84557
2026-03-27 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-27 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638
2026-03-27 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa788e2c-e5db-583a-9086-06980bff4626 with identifier: CR43638 to the API
2026-03-27 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'petrol',
 'id': 'fa788e2c-e5db-583a-9086-06980bff4626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR43638',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 343820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-30',
 'seller_name': None,
 'title': 'Volvo XC70 2.5 T AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2004}
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [auto1.nl] INFO: Saving data for CR43638: {'auction_closing_time': 1774714752.0, 'created_time': 1773688140.77592, 'last_price_update_time': 1774612880.141861}
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR43638') HTTP/1.1" 204 0
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_24a0bc5f12528b1583f9163cf5f82918.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_24a0bc5f12528b1583f9163cf5f82918.jpg not downloaded yet
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg not downloaded yet
2026-03-27 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY14996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME73088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-27 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d with scrape type 1
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96f461c9-4265-55cb-bcc0-023d3dc18d5d
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_3f39d31131c24b60355cf7a9bb5aed7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3f39d31131c24b60355cf7a9bb5aed7a.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_08955177d81afbd2425c0780fe23ec7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_08955177d81afbd2425c0780fe23ec7f.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_ba97f3d891f78299e15606ff0e0e9692.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_ba97f3d891f78299e15606ff0e0e9692.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_fa2ad13e36b6da32643173e9e8fee5de.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_fa2ad13e36b6da32643173e9e8fee5de.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_d252d8c59f690107800c53f5167433d1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_d252d8c59f690107800c53f5167433d1.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_e98b7bf21748f7e2555e94963040c924.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_e98b7bf21748f7e2555e94963040c924.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_9a20977b69b9bebce17d69dc96560093.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_9a20977b69b9bebce17d69dc96560093.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_4d9bcc6d1149396f690a72b0c3915c55.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_4d9bcc6d1149396f690a72b0c3915c55.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_3ff141058e1a81c50d0723a310473792.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3ff141058e1a81c50d0723a310473792.jpg already downloaded
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fac%252F70acaaf5765d940fb91f0ea12ab1262d%252Fpa%252FCX26987_71f9723e596388bfac00393bd2318af9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_71f9723e596388bfac00393bd2318af9.jpg already downloaded
2026-03-27 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f461c9-4265-55cb-bcc0-023d3dc18d5d, identifier: CX26987
2026-03-27 12:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0bec50>
2026-03-27 12:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg saved to cache
2026-03-27 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-27 12:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557
2026-03-27 12:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ae2506ce-9cca-5295-a0b0-d9ad8efa4626 with identifier: DH84557 to the API
2026-03-27 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:09:26Z',
 'fuel_type': 'petrol',
 'id': 'ae2506ce-9cca-5295-a0b0-d9ad8efa4626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH84557',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 195422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-27 12:01:21 [auto1.nl] INFO: Saving data for DH84557: {'auction_closing_time': 1774714166.0, 'created_time': 1773132746.16432, 'last_price_update_time': 1774612881.159767}
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH84557') HTTP/1.1" 204 0
2026-03-27 12:01:21 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-27 12:01:21 [auto1.nl] INFO: Scrape type for ZD26534: 2
2026-03-27 12:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-27 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-27 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with scrape type 2
2026-03-27 12:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9, identifier: ZD26534
2026-03-27 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-27 12:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987
2026-03-27 12:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f461c9-4265-55cb-bcc0-023d3dc18d5d with identifier: CX26987 to the API
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX26987>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'petrol',
 'id': '96f461c9-4265-55cb-bcc0-023d3dc18d5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SV596X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX26987',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 61131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3f39d31131c24b60355cf7a9bb5aed7a.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_08955177d81afbd2425c0780fe23ec7f.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_ba97f3d891f78299e15606ff0e0e9692.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_fa2ad13e36b6da32643173e9e8fee5de.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_d252d8c59f690107800c53f5167433d1.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_e98b7bf21748f7e2555e94963040c924.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_9a20977b69b9bebce17d69dc96560093.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_4d9bcc6d1149396f690a72b0c3915c55.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3ff141058e1a81c50d0723a310473792.jpg',
                'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_71f9723e596388bfac00393bd2318af9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2641677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3f39d31131c24b60355cf7a9bb5aed7a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2675112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_08955177d81afbd2425c0780fe23ec7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_ba97f3d891f78299e15606ff0e0e9692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398778,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_fa2ad13e36b6da32643173e9e8fee5de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2567304,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_d252d8c59f690107800c53f5167433d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2543184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_e98b7bf21748f7e2555e94963040c924.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_9a20977b69b9bebce17d69dc96560093.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2476675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_4d9bcc6d1149396f690a72b0c3915c55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_3ff141058e1a81c50d0723a310473792.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96f461c9-4265-55cb-bcc0-023d3dc18d5d/96f461c9-4265-55cb-bcc0-023d3dc18d5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/ac/70acaaf5765d940fb91f0ea12ab1262d/pa/CX26987_71f9723e596388bfac00393bd2318af9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-27 12:01:21 [auto1.nl] INFO: Saving data for CX26987: {'created_time': 1774612881.636129, 'last_price_update_time': 1774612881.636143, 'auction_closing_time': 1774713887.0}
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX26987') HTTP/1.1" 204 0
2026-03-27 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:21 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-27 12:01:21 [auto1.nl] INFO: Scrape type for WS29354: 2
2026-03-27 12:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-27 12:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-27 12:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1fa8f90-f881-58b0-ab46-6f3480823f82 with scrape type 2
2026-03-27 12:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1fa8f90-f881-58b0-ab46-6f3480823f82, identifier: WS29354
2026-03-27 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 12:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534
2026-03-27 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b55b8a52-4a17-50e8-bf86-3bbf8f9513e9 with identifier: ZD26534 to the API
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-28T16:28:28Z',
 'fuel_type': 'petrol',
 'id': 'b55b8a52-4a17-50e8-bf86-3bbf8f9513e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD26534',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-03-31',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Privilege',
 'transmission': 'automatic',
 'trim': 'Privilege',
 'year': 2001}
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-27 12:01:22 [auto1.nl] INFO: Saving data for ZD26534: {'auction_closing_time': 1774715308.0, 'created_time': 1774119703.372047, 'last_price_update_time': 1774612882.28104}
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZD26534') HTTP/1.1" 204 0
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_0a079a6c465b3bb9676576dad50e32d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_0a079a6c465b3bb9676576dad50e32d2.jpg not downloaded yet
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_e6d6e750737927bd0c57e880a82f0bee.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_e6d6e750737927bd0c57e880a82f0bee.jpg not downloaded yet
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becc99d0>
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg saved to cache
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be148510>
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg saved to cache
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed9a050>
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_87f83c980bba0bdb62590e0cea444cef.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_87f83c980bba0bdb62590e0cea444cef.jpg saved to cache
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be187cd0>
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_4b9571e31674a2b73ccd6e4566573589.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_4b9571e31674a2b73ccd6e4566573589.jpg saved to cache
2026-03-27 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-27 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354
2026-03-27 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1fa8f90-f881-58b0-ab46-6f3480823f82 with identifier: WS29354 to the API
2026-03-27 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:30:58Z',
 'fuel_type': 'hybrid',
 'id': 'c1fa8f90-f881-58b0-ab46-6f3480823f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS29354',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 100541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2019}
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-27 12:01:23 [auto1.nl] INFO: Saving data for WS29354: {'auction_closing_time': 1774715458.0, 'created_time': 1773514874.68678, 'last_price_update_time': 1774612883.713358}
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS29354') HTTP/1.1" 204 0
2026-03-27 12:01:23 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-27 12:01:23 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-27 12:01:23 [auto1.nl] INFO: Scrape type for LZ16255: 2
2026-03-27 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-27 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-27 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40131f07-463d-5f7f-807e-464c2c26bec6 with scrape type 2
2026-03-27 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40131f07-463d-5f7f-807e-464c2c26bec6, identifier: LZ16255
2026-03-27 12:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM29173/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:23 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1060 | hits on page: 40
2026-03-27 12:01:23 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-27 12:01:23 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-27 12:01:23 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-27 12:01:23 [auto1.nl] INFO: Scrape type for FS82995: 2
2026-03-27 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-27 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4eb32a20-1123-5517-88f8-6f90829852a0 with scrape type 2
2026-03-27 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4eb32a20-1123-5517-88f8-6f90829852a0 with scrape type 2
2026-03-27 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4eb32a20-1123-5517-88f8-6f90829852a0, identifier: FS82995
2026-03-27 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-27 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255
2026-03-27 12:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40131f07-463d-5f7f-807e-464c2c26bec6 with identifier: LZ16255 to the API
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '40131f07-463d-5f7f-807e-464c2c26bec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ16255',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 176051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 HDi L2 Pack Clim NAV',
 'transmission': 'manual',
 'trim': 'L2 Pack Clim NAV',
 'year': 2016}
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-27 12:01:24 [auto1.nl] INFO: Saving data for LZ16255: {'auction_closing_time': 1774716565.0, 'created_time': 1773134125.440572, 'last_price_update_time': 1774612884.305346}
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ16255') HTTP/1.1" 204 0
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg not downloaded yet
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_b34877d1183a818eedb225f0733b2cd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_b34877d1183a818eedb225f0733b2cd4.jpg not downloaded yet
2026-03-27 12:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beab43d0>
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg saved to cache
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becf0990>
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg saved to cache
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_a090b08a6b130f0af97f6b1130d2c92d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_0c51c5d796604702b2c1864a01953a87.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_87eca9b8250bccabfd8143676780d261.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1d90ffbc42f8742952397168a5cabc82.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-27 12:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995
2026-03-27 12:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4eb32a20-1123-5517-88f8-6f90829852a0 with identifier: FS82995 to the API
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:26:27Z',
 'fuel_type': 'petrol',
 'id': '4eb32a20-1123-5517-88f8-6f90829852a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS82995',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 188888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-27 12:01:24 [auto1.nl] INFO: Saving data for FS82995: {'auction_closing_time': 1774715187.0, 'created_time': 1774267339.20437, 'last_price_update_time': 1774612884.928047}
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FS82995') HTTP/1.1" 204 0
2026-03-27 12:01:24 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-27 12:01:24 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-27 12:01:24 [auto1.nl] INFO: Scrape type for KV65945: 2
2026-03-27 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-27 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-27 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with scrape type 2
2026-03-27 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd, identifier: KV65945
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [auto1.nl] INFO: Scrape type for TU10821: 1
2026-03-27 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-27 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945
2026-03-27 12:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ce57fc6-21cb-5cf4-9505-b43c50982bfd with identifier: KV65945 to the API
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:58:53Z',
 'fuel_type': 'petrol',
 'id': '9ce57fc6-21cb-5cf4-9505-b43c50982bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV65945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 241139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [auto1.nl] INFO: Saving data for KV65945: {'auction_closing_time': 1774717133.0, 'created_time': 1773134595.059007, 'last_price_update_time': 1774612885.518242}
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV65945') HTTP/1.1" 204 0
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg not downloaded yet
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg not downloaded yet
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [auto1.nl] INFO: Scrape type for HH59485: 2
2026-03-27 12:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-27 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with scrape type 2
2026-03-27 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with scrape type 2
2026-03-27 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d492c8e-59d2-5069-8895-1a95c64c6ce6, identifier: HH59485
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-27 12:01:25 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-27 12:01:25 [auto1.nl] INFO: Scrape type for ET49040: 2
2026-03-27 12:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-27 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-27 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with scrape type 2
2026-03-27 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14436c4b-d70a-5d2f-9e2b-e80701a321d1, identifier: ET49040
2026-03-27 12:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_75ecde1cb6834ffb83df181b147967bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-27 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485
2026-03-27 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d492c8e-59d2-5069-8895-1a95c64c6ce6 with identifier: HH59485 to the API
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:24:51Z',
 'fuel_type': 'hybrid',
 'id': '7d492c8e-59d2-5069-8895-1a95c64c6ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH59485',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 119721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h E-Four Pack Business',
 'transmission': 'automatic',
 'trim': 'E-Four Pack Business',
 'year': 2016}
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-27 12:01:26 [auto1.nl] INFO: Saving data for HH59485: {'auction_closing_time': 1774715091.0, 'created_time': 1774292564.316202, 'last_price_update_time': 1774612886.262948}
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH59485') HTTP/1.1" 204 0
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_088b206afbe601766b46bc865e848f26.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_088b206afbe601766b46bc865e848f26.jpg not downloaded yet
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_d07a2cc36187dcde8da603563d38e427.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_d07a2cc36187dcde8da603563d38e427.jpg not downloaded yet
2026-03-27 12:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-27 12:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040
2026-03-27 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14436c4b-d70a-5d2f-9e2b-e80701a321d1 with identifier: ET49040 to the API
2026-03-27 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': '14436c4b-d70a-5d2f-9e2b-e80701a321d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET49040',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 158951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-10',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-27 12:01:27 [auto1.nl] INFO: Saving data for ET49040: {'auction_closing_time': 1774716320.0, 'created_time': 1773921682.734775, 'last_price_update_time': 1774612887.292604}
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ET49040') HTTP/1.1" 204 0
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beab62d0>
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_a090b08a6b130f0af97f6b1130d2c92d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_a090b08a6b130f0af97f6b1130d2c92d.jpg saved to cache
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf49950>
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_0c51c5d796604702b2c1864a01953a87.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_0c51c5d796604702b2c1864a01953a87.jpg saved to cache
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb726d0>
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_87eca9b8250bccabfd8143676780d261.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_87eca9b8250bccabfd8143676780d261.jpg saved to cache
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec4e050>
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg saved to cache
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed9a850>
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_1d90ffbc42f8742952397168a5cabc82.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1d90ffbc42f8742952397168a5cabc82.jpg saved to cache
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_e6d6e750737927bd0c57e880a82f0bee.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:27 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-27 12:01:27 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-27 12:01:27 [auto1.nl] INFO: Scrape type for NF23683: 1
2026-03-27 12:01:27 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-27 12:01:27 [auto1.nl] INFO: Scrape type for HX39878: 2
2026-03-27 12:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-27 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with scrape type 2
2026-03-27 12:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4, identifier: HX39878
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg not downloaded yet
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_f2b29feaaf1785e4f55175222b030691.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_f2b29feaaf1785e4f55175222b030691.jpg not downloaded yet
2026-03-27 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-27 12:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878
2026-03-27 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e56f71a-324e-5b5e-98ba-a45bc9312ca4 with identifier: HX39878 to the API
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:04:34Z',
 'fuel_type': 'diesel',
 'id': '3e56f71a-324e-5b5e-98ba-a45bc9312ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX39878',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 302684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Saving data for HX39878: {'auction_closing_time': 1774713874.0, 'created_time': 1773301433.958018, 'last_price_update_time': 1774612888.074508}
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX39878') HTTP/1.1" 204 0
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC04146> (referer: https://www.auto1.com/v1/car-details-view/UC04146/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Scrape type for WH69219: 1
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Scrape type for NH69771: 1
2026-03-27 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU82988> (referer: https://www.auto1.com/v1/car-details-view/YU82988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf5b610>
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_75ecde1cb6834ffb83df181b147967bb.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_75ecde1cb6834ffb83df181b147967bb.jpg saved to cache
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_fe061e0dd7cac5963a978080c4ad9179.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_fe061e0dd7cac5963a978080c4ad9179.jpg not downloaded yet
2026-03-27 12:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb92550>
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg saved to cache
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb97590>
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_e6d6e750737927bd0c57e880a82f0bee.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_e6d6e750737927bd0c57e880a82f0bee.jpg saved to cache
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Scrape type for ZX63291: 1
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-27 12:01:28 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Scrape type for MT73533: 2
2026-03-27 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-27 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2256f2db-0947-57ef-94a0-278089f7b68f with scrape type 2
2026-03-27 12:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2256f2db-0947-57ef-94a0-278089f7b68f, identifier: MT73533
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX89920/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL71418> (referer: https://www.auto1.com/v1/car-details-view/NL71418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_0a079a6c465b3bb9676576dad50e32d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg not downloaded yet
2026-03-27 12:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-27 12:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533
2026-03-27 12:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2256f2db-0947-57ef-94a0-278089f7b68f with identifier: MT73533 to the API
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:24:08Z',
 'fuel_type': 'diesel',
 'id': '2256f2db-0947-57ef-94a0-278089f7b68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT73533',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 113573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-11',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2010}
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-27 12:01:28 [auto1.nl] INFO: Saving data for MT73533: {'auction_closing_time': 1774715048.0, 'created_time': 1773923303.404222, 'last_price_update_time': 1774612888.994977}
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT73533') HTTP/1.1" 204 0
2026-03-27 12:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX38555> (referer: https://www.auto1.com/v1/car-details-view/GX38555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-27 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4960974-a60a-52ae-b22c-c15f6cd95b9c with scrape type 1
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg not downloaded yet
2026-03-27 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-27 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b15081e2-0adb-56ce-968a-e014ad60e99a with scrape type 1
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg not downloaded yet
2026-03-27 12:01:29 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [auto1.nl] INFO: Scrape type for BG94378: 2
2026-03-27 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-27 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with scrape type 2
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with scrape type 2
2026-03-27 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee, identifier: BG94378
2026-03-27 12:01:29 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-27 12:01:29 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [auto1.nl] INFO: Scrape type for ZY76952: 2
2026-03-27 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-27 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with scrape type 2
2026-03-27 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5fe40737-41f2-5ed0-b906-886d15eb0cb2, identifier: ZY76952
2026-03-27 12:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN50601> (referer: https://www.auto1.com/v1/car-details-view/RN50601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf59790>
2026-03-27 12:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg saved to cache
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_f2b29feaaf1785e4f55175222b030691.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-27 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378
2026-03-27 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c6fddb6-26c8-592e-a5bf-411dfbf85eee with identifier: BG94378 to the API
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:31Z',
 'fuel_type': 'petrol',
 'id': '7c6fddb6-26c8-592e-a5bf-411dfbf85eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG94378',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 317241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-20',
 'seller_name': None,
 'title': 'Opel Insignia 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [auto1.nl] INFO: Saving data for BG94378: {'auction_closing_time': 1774715491.0, 'created_time': 1774094465.091444, 'last_price_update_time': 1774612889.808976}
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG94378') HTTP/1.1" 204 0
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg not downloaded yet
2026-03-27 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-27 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952
2026-03-27 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5fe40737-41f2-5ed0-b906-886d15eb0cb2 with identifier: ZY76952 to the API
2026-03-27 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:20:14Z',
 'fuel_type': 'petrol',
 'id': '5fe40737-41f2-5ed0-b906-886d15eb0cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY76952',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 143558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [auto1.nl] INFO: Saving data for ZY76952: {'auction_closing_time': 1774714814.0, 'created_time': 1773302531.720045, 'last_price_update_time': 1774612890.165464}
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY76952') HTTP/1.1" 204 0
2026-03-27 12:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg not downloaded yet
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg not downloaded yet
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [auto1.nl] INFO: Scrape type for ZZ44063: 1
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [auto1.nl] INFO: Scrape type for BZ34461: 1
2026-03-27 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD33545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-27 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 1
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg not downloaded yet
2026-03-27 12:01:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea17a10>
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_0a079a6c465b3bb9676576dad50e32d2.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_0a079a6c465b3bb9676576dad50e32d2.jpg saved to cache
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg not downloaded yet
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_93d44e385ae1490f59f1688e8d222774.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_93d44e385ae1490f59f1688e8d222774.jpg not downloaded yet
2026-03-27 12:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_fe061e0dd7cac5963a978080c4ad9179.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [auto1.nl] INFO: Scrape type for DK51310: 1
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-27 12:01:30 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [auto1.nl] INFO: Scrape type for TY61758: 1
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_ac179b288f9982005b5bef29e8e4e204.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_ac179b288f9982005b5bef29e8e4e204.jpg not downloaded yet
2026-03-27 12:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-27 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bc6a37-99ac-5b61-b281-99edb0a170a8 with scrape type 1
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_7becab05dbf931bafe08fdff43f138a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_7becab05dbf931bafe08fdff43f138a4.jpg not downloaded yet
2026-03-27 12:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-27 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da26612-6df4-597e-8da2-c3e32bde619a with scrape type 1
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4da26612-6df4-597e-8da2-c3e32bde619a
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_3b2fdffc1d6900744749d7f8aa3f1d02.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_3b2fdffc1d6900744749d7f8aa3f1d02.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_a89a36cf52ada3354dae866c291ebd79.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_a89a36cf52ada3354dae866c291ebd79.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_870ed28daa7bba250e5cd4d452fc9021.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_870ed28daa7bba250e5cd4d452fc9021.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_d561f71a0eb3770e325acaa358c44030.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_d561f71a0eb3770e325acaa358c44030.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_b680b9dd298cec5bc532d42c9e8e3dd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_b680b9dd298cec5bc532d42c9e8e3dd4.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_763530f083fb6e00d303f16b93ebb1eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_763530f083fb6e00d303f16b93ebb1eb.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_cf8279dfde4da0955ee3be9569954777.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_cf8279dfde4da0955ee3be9569954777.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_c8270fc128d3b1284878624bec135b37.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_c8270fc128d3b1284878624bec135b37.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_71a619817cb66ff6f2f4d5bcd18b4d34.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_71a619817cb66ff6f2f4d5bcd18b4d34.jpg already downloaded
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F7b%252F377b16065c1b5178213152e5598eefaf%252Fpa%252FRN50601_ce27571ed373709a6bc042557f52853d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_ce27571ed373709a6bc042557f52853d.jpg already downloaded
2026-03-27 12:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4da26612-6df4-597e-8da2-c3e32bde619a, identifier: RN50601
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed9a310>
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_f2b29feaaf1785e4f55175222b030691.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_f2b29feaaf1785e4f55175222b030691.jpg saved to cache
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_67df09d3e9c29959243783fc6572ccf9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_67df09d3e9c29959243783fc6572ccf9.jpg not downloaded yet
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_d839f1101b5a4694ae0e635055f0565e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d839f1101b5a4694ae0e635055f0565e.jpg not downloaded yet
2026-03-27 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-27 12:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601
2026-03-27 12:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4da26612-6df4-597e-8da2-c3e32bde619a with identifier: RN50601 to the API
2026-03-27 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN50601>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:04Z',
 'fuel_type': 'petrol',
 'id': '4da26612-6df4-597e-8da2-c3e32bde619a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NH120S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN50601',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 103484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_3b2fdffc1d6900744749d7f8aa3f1d02.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_a89a36cf52ada3354dae866c291ebd79.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_870ed28daa7bba250e5cd4d452fc9021.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_d561f71a0eb3770e325acaa358c44030.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_b680b9dd298cec5bc532d42c9e8e3dd4.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_763530f083fb6e00d303f16b93ebb1eb.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_cf8279dfde4da0955ee3be9569954777.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_c8270fc128d3b1284878624bec135b37.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_71a619817cb66ff6f2f4d5bcd18b4d34.jpg',
                'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_ce27571ed373709a6bc042557f52853d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_3b2fdffc1d6900744749d7f8aa3f1d02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2166723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_a89a36cf52ada3354dae866c291ebd79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_870ed28daa7bba250e5cd4d452fc9021.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1897264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_d561f71a0eb3770e325acaa358c44030.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_b680b9dd298cec5bc532d42c9e8e3dd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3283378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_763530f083fb6e00d303f16b93ebb1eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2590407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_cf8279dfde4da0955ee3be9569954777.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_c8270fc128d3b1284878624bec135b37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638875,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_71a619817cb66ff6f2f4d5bcd18b4d34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4da26612-6df4-597e-8da2-c3e32bde619a/4da26612-6df4-597e-8da2-c3e32bde619a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img37/7b/377b16065c1b5178213152e5598eefaf/pa/RN50601_ce27571ed373709a6bc042557f52853d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-27 12:01:31 [auto1.nl] INFO: Saving data for RN50601: {'created_time': 1774612891.78819, 'last_price_update_time': 1774612891.7882, 'auction_closing_time': 1774716544.0}
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RN50601') HTTP/1.1" 204 0
2026-03-27 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:31 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-27 12:01:31 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-27 12:01:31 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-27 12:01:31 [auto1.nl] INFO: Scrape type for ZC66376: 1
2026-03-27 12:01:31 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-27 12:01:31 [auto1.nl] INFO: Scrape type for ZK51232: 1
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg not downloaded yet
2026-03-27 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg not downloaded yet
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_ab152e429eb73d0e4529044bf6352d9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ab152e429eb73d0e4529044bf6352d9b.jpg not downloaded yet
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_0e0efbe17277806df8412bae14bfece1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0e0efbe17277806df8412bae14bfece1.jpg not downloaded yet
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf3c1d0>
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg saved to cache
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb55d10>
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_fe061e0dd7cac5963a978080c4ad9179.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_fe061e0dd7cac5963a978080c4ad9179.jpg saved to cache
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:32 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-27 12:01:32 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [auto1.nl] INFO: Scrape type for ML03692: 2
2026-03-27 12:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-27 12:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57604818-8aff-580a-8450-8d0c5b6addd5 with scrape type 2
2026-03-27 12:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57604818-8aff-580a-8450-8d0c5b6addd5, identifier: ML03692
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg not downloaded yet
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg not downloaded yet
2026-03-27 12:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME73088> (referer: https://www.auto1.com/v1/car-details-view/ME73088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-27 12:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692
2026-03-27 12:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57604818-8aff-580a-8450-8d0c5b6addd5 with identifier: ML03692 to the API
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:59:50Z',
 'fuel_type': 'petrol',
 'id': '57604818-8aff-580a-8450-8d0c5b6addd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML03692',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-24',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Active 2WD',
 'transmission': 'manual',
 'trim': 'Active 2WD',
 'year': 2006}
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [auto1.nl] INFO: Saving data for ML03692: {'auction_closing_time': 1774717190.0, 'created_time': 1773343742.09665, 'last_price_update_time': 1774612892.779835}
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML03692') HTTP/1.1" 204 0
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_fee9fbace15a425980c7bd983b6bc18a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_fee9fbace15a425980c7bd983b6bc18a.jpg not downloaded yet
2026-03-27 12:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec77bd0>
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg saved to cache
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:32 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-27 12:01:32 [auto1.nl] INFO: Scrape type for NV42843: 2
2026-03-27 12:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-27 12:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-27 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14aed98b-74ab-5de5-987c-17d9cafc2f45 with scrape type 2
2026-03-27 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14aed98b-74ab-5de5-987c-17d9cafc2f45, identifier: NV42843
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg not downloaded yet
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg not downloaded yet
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb20e50>
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg saved to cache
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4240f10>
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg saved to cache
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:33 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1060 | hits on page: 40
2026-03-27 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-27 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843
2026-03-27 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14aed98b-74ab-5de5-987c-17d9cafc2f45 with identifier: NV42843 to the API
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:52Z',
 'fuel_type': 'petrol',
 'id': '14aed98b-74ab-5de5-987c-17d9cafc2f45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV42843',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 194299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Saving data for NV42843: {'auction_closing_time': 1774715692.0, 'created_time': 1773946977.983496, 'last_price_update_time': 1774612893.523406}
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV42843') HTTP/1.1" 204 0
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_8a91431753b65c5aca87ac4b1cf19060.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_8a91431753b65c5aca87ac4b1cf19060.jpg not downloaded yet
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0928d0>
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg saved to cache
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_7becab05dbf931bafe08fdff43f138a4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_67df09d3e9c29959243783fc6572ccf9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for GK86118: 1
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_5ec7fa8067fff12ccd5772716696aff0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_5ec7fa8067fff12ccd5772716696aff0.jpg not downloaded yet
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_77e1a82d03f6e95c50c97435b27330ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_77e1a82d03f6e95c50c97435b27330ea.jpg not downloaded yet
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: SG30589
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG30589%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for SG30589: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for XW85568: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX79285%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for MX79285: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: MP40330
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for DX60140: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for WG23592: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: LT47952
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT47952%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for LT47952: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: AG18358
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG18358%27 HTTP/1.1" 200 None
2026-03-27 12:01:33 [auto1.nl] INFO: Scrape type for AG18358: 0
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-27 12:01:33 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-27 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for PW38124: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: YT02782
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT02782%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for YT02782: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: JK17445
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK17445%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for JK17445: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: NX61669
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for EH82816: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for GA05511: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: CZ45443
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ45443%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for CZ45443: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: HF88100
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF88100%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for HF88100: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for WH77322: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-27 12:01:34 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [auto1.nl] INFO: Scrape type for DB77408: 0
2026-03-27 12:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-27 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with scrape type 1
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 345d9a56-61ba-57e4-b1c5-17f279b7ada9
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F5d%252Fcc5d4fbeec941de6c31f130176044324%252Fpa%252FME73088_effec4076150580b305dd12e701258ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_effec4076150580b305dd12e701258ec.jpg already downloaded
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F5d%252Fcc5d4fbeec941de6c31f130176044324%252Fpa%252FME73088_e4ffc3ca3e259419037043abb11e4fc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_e4ffc3ca3e259419037043abb11e4fc9.jpg already downloaded
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F5d%252Fcc5d4fbeec941de6c31f130176044324%252Fpa%252FME73088_7532cce2113f170c48659813e557dc76.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_7532cce2113f170c48659813e557dc76.jpg already downloaded
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F5d%252Fcc5d4fbeec941de6c31f130176044324%252Fpa%252FME73088_d4d628bdbf2c4f9f2e72c14ecfc76107.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_d4d628bdbf2c4f9f2e72c14ecfc76107.jpg already downloaded
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F5d%252Fcc5d4fbeec941de6c31f130176044324%252Fpa%252FME73088_b5eb7e84f4b10425246f2cb7dda0b27e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_b5eb7e84f4b10425246f2cb7dda0b27e.jpg already downloaded
2026-03-27 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 345d9a56-61ba-57e4-b1c5-17f279b7ada9, identifier: ME73088
2026-03-27 12:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedecb50>
2026-03-27 12:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg saved to cache
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_d2b55c42295cbda37ea59bd0c317294d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d2b55c42295cbda37ea59bd0c317294d.jpg not downloaded yet
2026-03-27 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-27 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088
2026-03-27 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 345d9a56-61ba-57e4-b1c5-17f279b7ada9 with identifier: ME73088 to the API
2026-03-27 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME73088>
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:13:20Z',
 'fuel_type': 'diesel',
 'id': '345d9a56-61ba-57e4-b1c5-17f279b7ada9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '02PRG1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME73088',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 175572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_effec4076150580b305dd12e701258ec.jpg',
                'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_e4ffc3ca3e259419037043abb11e4fc9.jpg',
                'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_7532cce2113f170c48659813e557dc76.jpg',
                'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_d4d628bdbf2c4f9f2e72c14ecfc76107.jpg',
                'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_b5eb7e84f4b10425246f2cb7dda0b27e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345d9a56-61ba-57e4-b1c5-17f279b7ada9/345d9a56-61ba-57e4-b1c5-17f279b7ada9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_effec4076150580b305dd12e701258ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345d9a56-61ba-57e4-b1c5-17f279b7ada9/345d9a56-61ba-57e4-b1c5-17f279b7ada9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_e4ffc3ca3e259419037043abb11e4fc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345d9a56-61ba-57e4-b1c5-17f279b7ada9/345d9a56-61ba-57e4-b1c5-17f279b7ada9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_7532cce2113f170c48659813e557dc76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345d9a56-61ba-57e4-b1c5-17f279b7ada9/345d9a56-61ba-57e4-b1c5-17f279b7ada9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28785,
             'Height': 255,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_d4d628bdbf2c4f9f2e72c14ecfc76107.jpg',
             'Width': 340},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_345d9a56-61ba-57e4-b1c5-17f279b7ada9/345d9a56-61ba-57e4-b1c5-17f279b7ada9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/5d/cc5d4fbeec941de6c31f130176044324/pa/ME73088_b5eb7e84f4b10425246f2cb7dda0b27e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Saving data for ME73088: {'created_time': 1774612895.277212, 'last_price_update_time': 1774612895.277221, 'auction_closing_time': 1774714400.0}
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME73088') HTTP/1.1" 204 0
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ab152e429eb73d0e4529044bf6352d9b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0e0efbe17277806df8412bae14bfece1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for AG89497: 1
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_be7ac175649c27867f56efe057d91dfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_be7ac175649c27867f56efe057d91dfb.jpg not downloaded yet
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_c7de3ad52370e83265b977d12ec1bff0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_c7de3ad52370e83265b977d12ec1bff0.jpg not downloaded yet
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH69771/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF23683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM29173> (referer: https://www.auto1.com/v1/car-details-view/VM29173/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY14996> (referer: https://www.auto1.com/v1/car-details-view/LY14996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH69219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beca6250>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_7becab05dbf931bafe08fdff43f138a4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_7becab05dbf931bafe08fdff43f138a4.jpg saved to cache
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf55250>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_67df09d3e9c29959243783fc6572ccf9.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_67df09d3e9c29959243783fc6572ccf9.jpg saved to cache
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for BZ17478: 0
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for GZ48867: 0
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: MU80357
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-27 12:01:35 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_c601668cce5c61c8c91c3c012eea93f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_c601668cce5c61c8c91c3c012eea93f1.jpg not downloaded yet
2026-03-27 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_80e4910b7c37428a801813df4eccc016.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_80e4910b7c37428a801813df4eccc016.jpg not downloaded yet
2026-03-27 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea50d90>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg saved to cache
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_56044f37851c11acba859e466f9ce3b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_56044f37851c11acba859e466f9ce3b5.jpg not downloaded yet
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_5ec7fa8067fff12ccd5772716696aff0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_8a91431753b65c5aca87ac4b1cf19060.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_77e1a82d03f6e95c50c97435b27330ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec55fd0>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_ab152e429eb73d0e4529044bf6352d9b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ab152e429eb73d0e4529044bf6352d9b.jpg saved to cache
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4e3d410>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_0e0efbe17277806df8412bae14bfece1.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0e0efbe17277806df8412bae14bfece1.jpg saved to cache
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-27 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 1
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg not downloaded yet
2026-03-27 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-27 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 196f2cb0-434f-52b9-bc64-560496d53918 with scrape type 1
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_f572deb751cd00f8edcafcd8412e2eae.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_f572deb751cd00f8edcafcd8412e2eae.jpg not downloaded yet
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg not downloaded yet
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg not downloaded yet
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg not downloaded yet
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec373d0>
2026-03-27 12:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becd35d0>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_5ec7fa8067fff12ccd5772716696aff0.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_5ec7fa8067fff12ccd5772716696aff0.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec4d210>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_8a91431753b65c5aca87ac4b1cf19060.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_8a91431753b65c5aca87ac4b1cf19060.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bede0f10>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_77e1a82d03f6e95c50c97435b27330ea.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_77e1a82d03f6e95c50c97435b27330ea.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_be7ac175649c27867f56efe057d91dfb.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg not downloaded yet
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg not downloaded yet
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_c7de3ad52370e83265b977d12ec1bff0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_80e4910b7c37428a801813df4eccc016.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg not downloaded yet
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg not downloaded yet
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX63291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_09c45728983429338c36bc1c6854e67b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_166f61b62245e88e763572eef6e5085f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_166f61b62245e88e763572eef6e5085f.jpg not downloaded yet
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_3af7285450431572fb328873a436f52a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_3af7285450431572fb328873a436f52a.jpg not downloaded yet
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becd0d90>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_be7ac175649c27867f56efe057d91dfb.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_be7ac175649c27867f56efe057d91dfb.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf6d410>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_c7de3ad52370e83265b977d12ec1bff0.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_c7de3ad52370e83265b977d12ec1bff0.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be072790>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_80e4910b7c37428a801813df4eccc016.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_80e4910b7c37428a801813df4eccc016.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becd3510>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_c601668cce5c61c8c91c3c012eea93f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf29c50>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_09c45728983429338c36bc1c6854e67b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_09c45728983429338c36bc1c6854e67b.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_fee9fbace15a425980c7bd983b6bc18a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4e3e990>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebf1110>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_c601668cce5c61c8c91c3c012eea93f1.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_c601668cce5c61c8c91c3c012eea93f1.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedd1950>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD33545> (referer: https://www.auto1.com/v1/car-details-view/SD33545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d839f1101b5a4694ae0e635055f0565e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_3af7285450431572fb328873a436f52a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea52f90>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1bbc10>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_fee9fbace15a425980c7bd983b6bc18a.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_fee9fbace15a425980c7bd983b6bc18a.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1e1dd0>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_f572deb751cd00f8edcafcd8412e2eae.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG89497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec9b410>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg saved to cache
2026-03-27 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf6f5d0>
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-27 12:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 1
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg not downloaded yet
2026-03-27 12:01:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1ad690>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_d839f1101b5a4694ae0e635055f0565e.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d839f1101b5a4694ae0e635055f0565e.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea53450>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_3af7285450431572fb328873a436f52a.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_3af7285450431572fb328873a436f52a.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_166f61b62245e88e763572eef6e5085f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_7eb1188181ee73ac38044fb6f706834a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_7eb1188181ee73ac38044fb6f706834a.jpg not downloaded yet
2026-03-27 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK86118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_9fa315edd322429ff9df7a40d3603067.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9fa315edd322429ff9df7a40d3603067.jpg not downloaded yet
2026-03-27 12:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec35fd0>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beccae10>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252Ff6%252F9df6f1b7797cb7ca43c0f18ec3f0a4b2%252Fpa%252FLY14996_f572deb751cd00f8edcafcd8412e2eae.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_f572deb751cd00f8edcafcd8412e2eae.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 196f2cb0-434f-52b9-bc64-560496d53918
2026-03-27 12:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 196f2cb0-434f-52b9-bc64-560496d53918, skipping ID generation
2026-03-27 12:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 196f2cb0-434f-52b9-bc64-560496d53918 with scrape type 1
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 196f2cb0-434f-52b9-bc64-560496d53918 sending to next pipeline
2026-03-27 12:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 196f2cb0-434f-52b9-bc64-560496d53918, identifier: LY14996
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bead6d50>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be073790>
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg saved to cache
2026-03-27 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-27 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996
2026-03-27 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 196f2cb0-434f-52b9-bc64-560496d53918 with identifier: LY14996 to the API
2026-03-27 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_f572deb751cd00f8edcafcd8412e2eae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:59:23Z',
 'fuel_type': 'petrol',
 'id': '196f2cb0-434f-52b9-bc64-560496d53918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3XKP60',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY14996',
 'listing': 'auction',
 'location': 'NL, Gouda',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 201367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_f572deb751cd00f8edcafcd8412e2eae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_8b31d6cd36de2138ebae6b8acc61952d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_a86ee54c50b1d433c8e1aa0fb076a013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_2d4f4cfff5a01d07b21422264c6d60ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_196f2cb0-434f-52b9-bc64-560496d53918/196f2cb0-434f-52b9-bc64-560496d53918_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/f6/9df6f1b7797cb7ca43c0f18ec3f0a4b2/pa/LY14996_3af7285450431572fb328873a436f52a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 B-Easy',
 'transmission': 'manual',
 'trim': 'B-Easy',
 'year': 2014}
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-27 12:01:38 [auto1.nl] INFO: Saving data for LY14996: {'created_time': 1774612898.840138, 'last_price_update_time': 1774612898.840149, 'auction_closing_time': 1774717163.0}
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY14996') HTTP/1.1" 204 0
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg not downloaded yet
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d2b55c42295cbda37ea59bd0c317294d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_56044f37851c11acba859e466f9ce3b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF23683> (referer: https://www.auto1.com/v1/car-details-view/NF23683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH69219> (referer: https://www.auto1.com/v1/car-details-view/WH69219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX63291> (referer: https://www.auto1.com/v1/car-details-view/ZX63291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be09bfd0>
2026-03-27 12:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252Fe8%252F70e8ccf5069efb668e6162cbc772e031%252Fpa%252FVM29173_166f61b62245e88e763572eef6e5085f.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_166f61b62245e88e763572eef6e5085f.jpg saved to cache
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f84e3317-ddd1-523b-9a75-a66dcc4b3359
2026-03-27 12:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f84e3317-ddd1-523b-9a75-a66dcc4b3359, skipping ID generation
2026-03-27 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 with scrape type 1
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f84e3317-ddd1-523b-9a75-a66dcc4b3359 sending to next pipeline
2026-03-27 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f84e3317-ddd1-523b-9a75-a66dcc4b3359, identifier: VM29173
2026-03-27 12:01:39 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1060 | hits on page: 40
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_ac179b288f9982005b5bef29e8e4e204.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_9014dff8695fa06b9a94a4b47863f221.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9014dff8695fa06b9a94a4b47863f221.jpg not downloaded yet
2026-03-27 12:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU31497> (referer: https://www.auto1.com/v1/car-details-view/FU31497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-27 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173
2026-03-27 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f84e3317-ddd1-523b-9a75-a66dcc4b3359 with identifier: VM29173 to the API
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_166f61b62245e88e763572eef6e5085f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.0L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:30:25Z',
 'fuel_type': 'petrol',
 'id': 'f84e3317-ddd1-523b-9a75-a66dcc4b3359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '93HVZJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM29173',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 165517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_7c27ba90efbeeca48e9298a99b2bb6d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_a9fb6a3eebe8a6631d3fbf09ce69db85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_ac23e6c81bfffd9c210c78655bd141e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_5dbcf1c2816b89b9b2c20745e9a279a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f84e3317-ddd1-523b-9a75-a66dcc4b3359/f84e3317-ddd1-523b-9a75-a66dcc4b3359_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/e8/70e8ccf5069efb668e6162cbc772e031/pa/VM29173_166f61b62245e88e763572eef6e5085f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-01-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Hyundai Atos 1.0 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2002}
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-27 12:01:39 [auto1.nl] INFO: Saving data for VM29173: {'created_time': 1774612899.552988, 'last_price_update_time': 1774612899.552999, 'auction_closing_time': 1774715425.0}
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM29173') HTTP/1.1" 204 0
2026-03-27 12:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:39 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-27 12:01:39 [auto1.nl] INFO: Scrape type for SX81397: 2
2026-03-27 12:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-27 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with scrape type 2
2026-03-27 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657, identifier: SX81397
2026-03-27 12:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_7eb1188181ee73ac38044fb6f706834a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg not downloaded yet
2026-03-27 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-27 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397
2026-03-27 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0b1aff7c-92ee-5b89-a34a-fcb0810c6657 with identifier: SX81397 to the API
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-27T16:49:11Z',
 'fuel_type': 'diesel',
 'id': '0b1aff7c-92ee-5b89-a34a-fcb0810c6657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX81397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 195017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten Hochdach lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Kasten Hochdach lang 4Motion',
 'year': 2017}
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Saving data for SX81397: {'auction_closing_time': 1774630151.0, 'created_time': 1773232031.892876, 'last_price_update_time': 1774612900.028278}
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX81397') HTTP/1.1" 204 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for PM08403: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: UE02482
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE02482%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for UE02482: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: AD04128
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: XU05010
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU05010%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for XU05010: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for TT16898: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for TV49016: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for BU17435: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for UH74159: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: ZF00189
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZF00189%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for ZF00189: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: SA52781
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA52781%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for SA52781: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for PG05474: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: TX41951
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: WF43043
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF43043%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for WF43043: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: CG74252
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG74252%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for CG74252: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: UA29680
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PB06350
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB06350%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for PB06350: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: AT48749
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT48749%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for AT48749: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: PA83698
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA83698%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for PA83698: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: CK25026
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for KN68466: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-27 12:01:40 [auto1.nl] INFO: Found listing with ID: CM88074
2026-03-27 12:01:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb22f10>
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_d2b55c42295cbda37ea59bd0c317294d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d2b55c42295cbda37ea59bd0c317294d.jpg saved to cache
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1e2150>
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_56044f37851c11acba859e466f9ce3b5.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_56044f37851c11acba859e466f9ce3b5.jpg saved to cache
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-27 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 1
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_ed653633650786b9dc50674d4abbadbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_ed653633650786b9dc50674d4abbadbc.jpg not downloaded yet
2026-03-27 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-27 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 1
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg not downloaded yet
2026-03-27 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-27 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b713f838-6685-5d90-b854-e23da1bc833d with scrape type 1
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b713f838-6685-5d90-b854-e23da1bc833d
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_5342b09d614980bb85b2d41119b668dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_5342b09d614980bb85b2d41119b668dd.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_8e9432a5791438bc75bf155ba3ee2325.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_8e9432a5791438bc75bf155ba3ee2325.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_fd49cc5dbcd031a1a78bc0a0bb43f705.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_fd49cc5dbcd031a1a78bc0a0bb43f705.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_35a9862a02a0dc629e903bde14964018.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_35a9862a02a0dc629e903bde14964018.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_b57b8e459cbf459bb2d147a5071161f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_b57b8e459cbf459bb2d147a5071161f6.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_17eb68d59d889c79a9da381149009e89.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_17eb68d59d889c79a9da381149009e89.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_2a913321d25df5cde46d867b0fdac05f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_2a913321d25df5cde46d867b0fdac05f.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_27751a0d04614c1ebd281e73e10a7fec.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_27751a0d04614c1ebd281e73e10a7fec.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_d7dad064471031f2fd8c11021e1e3ca9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_d7dad064471031f2fd8c11021e1e3ca9.jpg already downloaded
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F0c%252F980c817cb8ad8e94b03084ede0b62c68%252Fpa%252FZX63291_989981e88e26d66600dc610ab9be0b28.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_989981e88e26d66600dc610ab9be0b28.jpg already downloaded
2026-03-27 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b713f838-6685-5d90-b854-e23da1bc833d, identifier: ZX63291
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf810d0>
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg saved to cache
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed78190>
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_ac179b288f9982005b5bef29e8e4e204.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_ac179b288f9982005b5bef29e8e4e204.jpg saved to cache
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec37810>
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252Fc3%252F6bc32d82d1a3cd74550abfb9166a1422%252Fpa%252FGX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg saved to cache
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26bc6a37-99ac-5b61-b281-99edb0a170a8
2026-03-27 12:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 26bc6a37-99ac-5b61-b281-99edb0a170a8, skipping ID generation
2026-03-27 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bc6a37-99ac-5b61-b281-99edb0a170a8 with scrape type 1
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 26bc6a37-99ac-5b61-b281-99edb0a170a8 sending to next pipeline
2026-03-27 12:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 26bc6a37-99ac-5b61-b281-99edb0a170a8, identifier: GX38555
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed7a050>
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fde%252F1ade9e7aa71f1f39f40392a88bf1fd2d%252Fpa%252FNL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg saved to cache
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963
2026-03-27 12:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963, skipping ID generation
2026-03-27 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with scrape type 1
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 sending to next pipeline
2026-03-27 12:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963, identifier: NL71418
2026-03-27 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-27 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 1
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg not downloaded yet
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_5540e7e6dc7e26a461d768c56a490653.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_5540e7e6dc7e26a461d768c56a490653.jpg not downloaded yet
2026-03-27 12:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-27 12:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291
2026-03-27 12:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b713f838-6685-5d90-b854-e23da1bc833d with identifier: ZX63291 to the API
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZX63291>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:34:10Z',
 'fuel_type': 'petrol',
 'id': 'b713f838-6685-5d90-b854-e23da1bc833d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RJ134K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX63291',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 128430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_5342b09d614980bb85b2d41119b668dd.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_8e9432a5791438bc75bf155ba3ee2325.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_fd49cc5dbcd031a1a78bc0a0bb43f705.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_35a9862a02a0dc629e903bde14964018.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_b57b8e459cbf459bb2d147a5071161f6.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_17eb68d59d889c79a9da381149009e89.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_2a913321d25df5cde46d867b0fdac05f.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_27751a0d04614c1ebd281e73e10a7fec.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_d7dad064471031f2fd8c11021e1e3ca9.jpg',
                'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_989981e88e26d66600dc610ab9be0b28.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_5342b09d614980bb85b2d41119b668dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_8e9432a5791438bc75bf155ba3ee2325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_fd49cc5dbcd031a1a78bc0a0bb43f705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_35a9862a02a0dc629e903bde14964018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_b57b8e459cbf459bb2d147a5071161f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_17eb68d59d889c79a9da381149009e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_2a913321d25df5cde46d867b0fdac05f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_27751a0d04614c1ebd281e73e10a7fec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_d7dad064471031f2fd8c11021e1e3ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b713f838-6685-5d90-b854-e23da1bc833d/b713f838-6685-5d90-b854-e23da1bc833d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/0c/980c817cb8ad8e94b03084ede0b62c68/pa/ZX63291_989981e88e26d66600dc610ab9be0b28.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 THP Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2017}
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-27 12:01:41 [auto1.nl] INFO: Saving data for ZX63291: {'created_time': 1774612901.721575, 'last_price_update_time': 1774612901.721585, 'auction_closing_time': 1774715650.0}
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX63291') HTTP/1.1" 204 0
2026-03-27 12:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-27 12:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555
2026-03-27 12:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 26bc6a37-99ac-5b61-b281-99edb0a170a8 with identifier: GX38555 to the API
2026-03-27 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:16:54Z',
 'fuel_type': 'petrol',
 'id': '26bc6a37-99ac-5b61-b281-99edb0a170a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '88XTR7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX38555',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 239004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_7becab05dbf931bafe08fdff43f138a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_813cecdfc485e0db98b3bb2e5744d57c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_cbd1cd190aa4633ff341a43c7fbba921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_b998e2e563aabe6f2df5bd8211e4eee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26bc6a37-99ac-5b61-b281-99edb0a170a8/26bc6a37-99ac-5b61-b281-99edb0a170a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/c3/6bc32d82d1a3cd74550abfb9166a1422/pa/GX38555_77e1a82d03f6e95c50c97435b27330ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-15',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [auto1.nl] INFO: Saving data for GX38555: {'created_time': 1774612902.244104, 'last_price_update_time': 1774612902.244114, 'auction_closing_time': 1774714614.0}
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GX38555') HTTP/1.1" 204 0
2026-03-27 12:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-27 12:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418
2026-03-27 12:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a4a1b86-6d0e-5cfd-8018-5fe9da422963 with identifier: NL71418 to the API
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:40:06Z',
 'fuel_type': 'petrol',
 'id': '7a4a1b86-6d0e-5cfd-8018-5fe9da422963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL71418',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mazda',
 'model': '3',
 'odometer': 229363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 22,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_bf87398034f43fae4c6eff5c6f5f2e5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_ac179b288f9982005b5bef29e8e4e204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_8ac27a04d01ad216bc64b71cbdfef0c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_3ca0d157646dc2152d0537b6eb4230dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_db5e93d294d07afe1b3c90a9ed1fce37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_5ec7fa8067fff12ccd5772716696aff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_be7ac175649c27867f56efe057d91dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_c601668cce5c61c8c91c3c012eea93f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_56044f37851c11acba859e466f9ce3b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a4a1b86-6d0e-5cfd-8018-5fe9da422963/7a4a1b86-6d0e-5cfd-8018-5fe9da422963_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/de/1ade9e7aa71f1f39f40392a88bf1fd2d/pa/NL71418_6ee3b65c94b3cbdcd6bf6d2ecd53a8c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Comfort',
 'transmission': 'automatic',
 'trim': 'Sport Comfort',
 'year': 2004}
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [auto1.nl] INFO: Saving data for NL71418: {'created_time': 1774612902.831196, 'last_price_update_time': 1774612902.831208, 'auction_closing_time': 1774716006.0}
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL71418') HTTP/1.1" 204 0
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_3b6228aefbdac457b45782f652aa4870.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_3b6228aefbdac457b45782f652aa4870.jpg not downloaded yet
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg not downloaded yet
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_7a42238ee706998326a212d2fe96045d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7a42238ee706998326a212d2fe96045d.jpg not downloaded yet
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_a05f60d47d9412fa5de9632c1af27292.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_a05f60d47d9412fa5de9632c1af27292.jpg not downloaded yet
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC66376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY61758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH69771> (referer: https://www.auto1.com/v1/car-details-view/NH69771/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK51232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec94a10>
2026-03-27 12:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_7eb1188181ee73ac38044fb6f706834a.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_7eb1188181ee73ac38044fb6f706834a.jpg saved to cache
2026-03-27 12:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_8f820c61f000936324e7cbf3a4da4824.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_8f820c61f000936324e7cbf3a4da4824.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_e01a86a1a0df49bb677b2352ed899245.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_e01a86a1a0df49bb677b2352ed899245.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg not downloaded yet
2026-03-27 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_13e00759eaba48554fba36a86e70e179.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_13e00759eaba48554fba36a86e70e179.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_33616feda3d9dfebf928941469ab23cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_33616feda3d9dfebf928941469ab23cf.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_25b6e36eea728ea92153f0c601823023.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_25b6e36eea728ea92153f0c601823023.jpg not downloaded yet
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedece90>
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F62%252F58625b0841f3123aba5d416e4594e3fc%252Fpa%252FUC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg saved to cache
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4960974-a60a-52ae-b22c-c15f6cd95b9c
2026-03-27 12:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4960974-a60a-52ae-b22c-c15f6cd95b9c, skipping ID generation
2026-03-27 12:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4960974-a60a-52ae-b22c-c15f6cd95b9c with scrape type 1
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4960974-a60a-52ae-b22c-c15f6cd95b9c sending to next pipeline
2026-03-27 12:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f4960974-a60a-52ae-b22c-c15f6cd95b9c, identifier: UC04146
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec89750>
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg saved to cache
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_896f176fdeb7603d467c921053d5e4dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_896f176fdeb7603d467c921053d5e4dd.jpg not downloaded yet
2026-03-27 12:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-27 12:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146
2026-03-27 12:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f4960974-a60a-52ae-b22c-c15f6cd95b9c with identifier: UC04146 to the API
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'petrol',
 'id': 'f4960974-a60a-52ae-b22c-c15f6cd95b9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '13PBS3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC04146',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 216917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_b1f9e2b6902b7fa5f6bea58927eceabd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_0639b4aa0a6b3f6706d2ff132ebcde00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ee239eb9a036a8b0aa5c12f0173ab102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_67df09d3e9c29959243783fc6572ccf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4960974-a60a-52ae-b22c-c15f6cd95b9c/f4960974-a60a-52ae-b22c-c15f6cd95b9c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/62/58625b0841f3123aba5d416e4594e3fc/pa/UC04146_ab152e429eb73d0e4529044bf6352d9b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [auto1.nl] INFO: Saving data for UC04146: {'created_time': 1774612903.73224, 'last_price_update_time': 1774612903.732256, 'auction_closing_time': 1774716882.0}
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC04146') HTTP/1.1" 204 0
2026-03-27 12:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9014dff8695fa06b9a94a4b47863f221.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_67ee77f9678e25226d183c2dc1c02861.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_67ee77f9678e25226d183c2dc1c02861.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_c5fa02d3e7bbcb392105b30791602f16.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c5fa02d3e7bbcb392105b30791602f16.jpg not downloaded yet
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg not downloaded yet
2026-03-27 12:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-27 12:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b945ca5-8729-5969-8084-dd3813847f20 with scrape type 1
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b945ca5-8729-5969-8084-dd3813847f20
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_1db5a6e0436efe641750ec97bb00b979.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_1db5a6e0436efe641750ec97bb00b979.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_7dd0cc1dd559f09069e6aff0b594500d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_7dd0cc1dd559f09069e6aff0b594500d.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_f3c4ce71220eda9e8e2d469eb71f3368.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f3c4ce71220eda9e8e2d469eb71f3368.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_cdd69d71162534ad9643455ef2f90777.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cdd69d71162534ad9643455ef2f90777.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_f2c510b6c7d00f903ab92b53a9608e29.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f2c510b6c7d00f903ab92b53a9608e29.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_209a3d2427fb085167fc2bd4442f0f21.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_209a3d2427fb085167fc2bd4442f0f21.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_e5961e68b323bf5c6c9debf26df3ca07.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_e5961e68b323bf5c6c9debf26df3ca07.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_5a4904c03674ad549c6842c0704072f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_5a4904c03674ad549c6842c0704072f0.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_cd4b20d251a71da3c52e326db5b1d104.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cd4b20d251a71da3c52e326db5b1d104.jpg already downloaded
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F04%252Fac04a2c48ef8e158a2e09f613036bb36%252Fpa%252FNH69771_b13e89451e94bf223b5a86ed4451d8bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_b13e89451e94bf223b5a86ed4451d8bc.jpg already downloaded
2026-03-27 12:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b945ca5-8729-5969-8084-dd3813847f20, identifier: NH69771
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7a42238ee706998326a212d2fe96045d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_5540e7e6dc7e26a461d768c56a490653.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-27 12:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771
2026-03-27 12:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b945ca5-8729-5969-8084-dd3813847f20 with identifier: NH69771 to the API
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH69771>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:27Z',
 'fuel_type': 'petrol',
 'id': '5b945ca5-8729-5969-8084-dd3813847f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L955XP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH69771',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 139134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_1db5a6e0436efe641750ec97bb00b979.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_7dd0cc1dd559f09069e6aff0b594500d.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f3c4ce71220eda9e8e2d469eb71f3368.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cdd69d71162534ad9643455ef2f90777.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f2c510b6c7d00f903ab92b53a9608e29.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_209a3d2427fb085167fc2bd4442f0f21.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_e5961e68b323bf5c6c9debf26df3ca07.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_5a4904c03674ad549c6842c0704072f0.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cd4b20d251a71da3c52e326db5b1d104.jpg',
                'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_b13e89451e94bf223b5a86ed4451d8bc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_1db5a6e0436efe641750ec97bb00b979.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_7dd0cc1dd559f09069e6aff0b594500d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f3c4ce71220eda9e8e2d469eb71f3368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cdd69d71162534ad9643455ef2f90777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_f2c510b6c7d00f903ab92b53a9608e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_209a3d2427fb085167fc2bd4442f0f21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_e5961e68b323bf5c6c9debf26df3ca07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_5a4904c03674ad549c6842c0704072f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_cd4b20d251a71da3c52e326db5b1d104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b945ca5-8729-5969-8084-dd3813847f20/5b945ca5-8729-5969-8084-dd3813847f20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/04/ac04a2c48ef8e158a2e09f613036bb36/pa/NH69771_b13e89451e94bf223b5a86ed4451d8bc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [auto1.nl] INFO: Saving data for NH69771: {'created_time': 1774612904.604052, 'last_price_update_time': 1774612904.604067, 'auction_closing_time': 1774714707.0}
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH69771') HTTP/1.1" 204 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_74659b50023f9a2bde5bc405e53a4d61.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_74659b50023f9a2bde5bc405e53a4d61.jpg not downloaded yet
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_6603fd9c348a5568f6c87ef91c404163.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_6603fd9c348a5568f6c87ef91c404163.jpg not downloaded yet
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG89497> (referer: https://www.auto1.com/v1/car-details-view/AG89497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BZ34461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK51310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX89920> (referer: https://www.auto1.com/v1/car-details-view/LX89920/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebe7710>
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_9014dff8695fa06b9a94a4b47863f221.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9014dff8695fa06b9a94a4b47863f221.jpg saved to cache
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_3b6228aefbdac457b45782f652aa4870.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg not downloaded yet
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg not downloaded yet
2026-03-27 12:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb3c2d0>
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg saved to cache
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf6c210>
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_7a42238ee706998326a212d2fe96045d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7a42238ee706998326a212d2fe96045d.jpg saved to cache
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed69710>
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_5540e7e6dc7e26a461d768c56a490653.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_5540e7e6dc7e26a461d768c56a490653.jpg saved to cache
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb69510>
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg saved to cache
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_25b6e36eea728ea92153f0c601823023.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_33616feda3d9dfebf928941469ab23cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg not downloaded yet
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg not downloaded yet
2026-03-27 12:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_896f176fdeb7603d467c921053d5e4dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-27 12:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with scrape type 1
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a7ec237-2a90-569e-8b1b-718a7386d8d4
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_e83d53110e4776b83430921a82400780.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_e83d53110e4776b83430921a82400780.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_8c73f391cdfb209ea90a964790063c58.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_8c73f391cdfb209ea90a964790063c58.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_4de62399782029a9678673b900b077e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_4de62399782029a9678673b900b077e8.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_9aad9146a11fa3a74382a1cd1fb04359.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_9aad9146a11fa3a74382a1cd1fb04359.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_7578ffd3564e4ccd750829a51ee1b649.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_7578ffd3564e4ccd750829a51ee1b649.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_ef8a81d74cd0c1d33d8bb5c63d6d5c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_ef8a81d74cd0c1d33d8bb5c63d6d5c7a.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_f11ef8692fbe2a06b28e572d7df2067b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_f11ef8692fbe2a06b28e572d7df2067b.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_72fd1ec58528fd1416c8e6ad23b06fd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_72fd1ec58528fd1416c8e6ad23b06fd8.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_086b4750c6875ca032ef77e30dbda3da.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_086b4750c6875ca032ef77e30dbda3da.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252Ffd%252F83fdc43e844e7afd375b4044480bad3b%252Fpa%252FAG89497_a8f8624734669194e819823411500493.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_a8f8624734669194e819823411500493.jpg already downloaded
2026-03-27 12:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7a7ec237-2a90-569e-8b1b-718a7386d8d4, identifier: AG89497
2026-03-27 12:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-27 12:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with scrape type 1
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_0d258d125b1f1d8966392d299dfcb33f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0d258d125b1f1d8966392d299dfcb33f.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_0071a9498f2ff6b9a8d304e89f37c1c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0071a9498f2ff6b9a8d304e89f37c1c8.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_85c3c41eb654ce751a557924ce2d03d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_85c3c41eb654ce751a557924ce2d03d3.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_9319f7b882d6bef3729cff5f3202e5e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_9319f7b882d6bef3729cff5f3202e5e5.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_6d66c08f902c7ce309f939806c9b99b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_6d66c08f902c7ce309f939806c9b99b0.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_5e6fc0ecc9e674d11fc2ee293380c973.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_5e6fc0ecc9e674d11fc2ee293380c973.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_b98b1cf9154ee8da0122a5bd001de7d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b98b1cf9154ee8da0122a5bd001de7d4.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_f4278df43936ba8a429334e5015c689f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_f4278df43936ba8a429334e5015c689f.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_a1853a03f22b3e8894d96ac4e6ad3d68.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_a1853a03f22b3e8894d96ac4e6ad3d68.jpg already downloaded
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F68%252Faf6847100419b0ddaf2d30306aa4c813%252Fpa%252FLX89920_b1e52db6d717f9b1612bbda1d0fad52a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b1e52db6d717f9b1612bbda1d0fad52a.jpg already downloaded
2026-03-27 12:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3, identifier: LX89920
2026-03-27 12:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4de9a90>
2026-03-27 12:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_3b6228aefbdac457b45782f652aa4870.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_3b6228aefbdac457b45782f652aa4870.jpg saved to cache
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_0be315b88930962e4d93dca208509bb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_0be315b88930962e4d93dca208509bb9.jpg not downloaded yet
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_b13c5032511ba5516a3e00a65a366889.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_b13c5032511ba5516a3e00a65a366889.jpg not downloaded yet
2026-03-27 12:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-27 12:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497
2026-03-27 12:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7a7ec237-2a90-569e-8b1b-718a7386d8d4 with identifier: AG89497 to the API
2026-03-27 12:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG89497>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:14:39Z',
 'fuel_type': 'diesel',
 'id': '7a7ec237-2a90-569e-8b1b-718a7386d8d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RT387T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG89497',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'BMW',
 'model': '3er',
 'odometer': 342341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_e83d53110e4776b83430921a82400780.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_8c73f391cdfb209ea90a964790063c58.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_4de62399782029a9678673b900b077e8.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_9aad9146a11fa3a74382a1cd1fb04359.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_7578ffd3564e4ccd750829a51ee1b649.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_ef8a81d74cd0c1d33d8bb5c63d6d5c7a.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_f11ef8692fbe2a06b28e572d7df2067b.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_72fd1ec58528fd1416c8e6ad23b06fd8.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_086b4750c6875ca032ef77e30dbda3da.jpg',
                'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_a8f8624734669194e819823411500493.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_e83d53110e4776b83430921a82400780.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2197445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_8c73f391cdfb209ea90a964790063c58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_4de62399782029a9678673b900b077e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2151234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_9aad9146a11fa3a74382a1cd1fb04359.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2497142,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_7578ffd3564e4ccd750829a51ee1b649.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_ef8a81d74cd0c1d33d8bb5c63d6d5c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56405,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_f11ef8692fbe2a06b28e572d7df2067b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1815157,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_72fd1ec58528fd1416c8e6ad23b06fd8.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2119237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_086b4750c6875ca032ef77e30dbda3da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a7ec237-2a90-569e-8b1b-718a7386d8d4/7a7ec237-2a90-569e-8b1b-718a7386d8d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2419396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/fd/83fdc43e844e7afd375b4044480bad3b/pa/AG89497_a8f8624734669194e819823411500493.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-27 12:01:46 [auto1.nl] INFO: Saving data for AG89497: {'created_time': 1774612906.109168, 'last_price_update_time': 1774612906.109178, 'auction_closing_time': 1774714479.0}
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AG89497') HTTP/1.1" 204 0
2026-03-27 12:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-27 12:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920
2026-03-27 12:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3 with identifier: LX89920 to the API
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX89920>
{'auction_title': '',
 'c_o_2_emission_value': 37,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:58:10Z',
 'fuel_type': 'hybrid',
 'id': '03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HTR37R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX89920',
 'listing': 'auction',
 'location': 'NL, Den Hout',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0d258d125b1f1d8966392d299dfcb33f.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0071a9498f2ff6b9a8d304e89f37c1c8.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_85c3c41eb654ce751a557924ce2d03d3.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_9319f7b882d6bef3729cff5f3202e5e5.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_6d66c08f902c7ce309f939806c9b99b0.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_5e6fc0ecc9e674d11fc2ee293380c973.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b98b1cf9154ee8da0122a5bd001de7d4.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_f4278df43936ba8a429334e5015c689f.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_a1853a03f22b3e8894d96ac4e6ad3d68.jpg',
                'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b1e52db6d717f9b1612bbda1d0fad52a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0d258d125b1f1d8966392d299dfcb33f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_0071a9498f2ff6b9a8d304e89f37c1c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_85c3c41eb654ce751a557924ce2d03d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_9319f7b882d6bef3729cff5f3202e5e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_6d66c08f902c7ce309f939806c9b99b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_5e6fc0ecc9e674d11fc2ee293380c973.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b98b1cf9154ee8da0122a5bd001de7d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_f4278df43936ba8a429334e5015c689f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_a1853a03f22b3e8894d96ac4e6ad3d68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3/03c73bd9-db7b-5ec4-9dd0-76af0cc6eda3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/68/af6847100419b0ddaf2d30306aa4c813/pa/LX89920_b1e52db6d717f9b1612bbda1d0fad52a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-27 12:01:46 [auto1.nl] INFO: Saving data for LX89920: {'created_time': 1774612906.852293, 'last_price_update_time': 1774612906.852306, 'auction_closing_time': 1774717090.0}
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX89920') HTTP/1.1" 204 0
2026-03-27 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_13e00759eaba48554fba36a86e70e179.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_74659b50023f9a2bde5bc405e53a4d61.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_6603fd9c348a5568f6c87ef91c404163.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg not downloaded yet
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg not downloaded yet
2026-03-27 12:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec3d490>
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_25b6e36eea728ea92153f0c601823023.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_25b6e36eea728ea92153f0c601823023.jpg saved to cache
2026-03-27 12:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be097410>
2026-03-27 12:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be18c610>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_33616feda3d9dfebf928941469ab23cf.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_33616feda3d9dfebf928941469ab23cf.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4e48390>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_896f176fdeb7603d467c921053d5e4dd.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_896f176fdeb7603d467c921053d5e4dd.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c5fa02d3e7bbcb392105b30791602f16.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb266d0>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_13e00759eaba48554fba36a86e70e179.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_13e00759eaba48554fba36a86e70e179.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed68190>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_74659b50023f9a2bde5bc405e53a4d61.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_74659b50023f9a2bde5bc405e53a4d61.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be06fd90>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_6603fd9c348a5568f6c87ef91c404163.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_6603fd9c348a5568f6c87ef91c404163.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1e2850>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1c5850>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_c5fa02d3e7bbcb392105b30791602f16.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c5fa02d3e7bbcb392105b30791602f16.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beacdd50>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_b13c5032511ba5516a3e00a65a366889.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_0be315b88930962e4d93dca208509bb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be179a50>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be010d90>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be06d950>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_93d44e385ae1490f59f1688e8d222774.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK86118> (referer: https://www.auto1.com/v1/car-details-view/GK86118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9fa315edd322429ff9df7a40d3603067.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ44063/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb27290>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_b13c5032511ba5516a3e00a65a366889.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_b13c5032511ba5516a3e00a65a366889.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bece08d0>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_0be315b88930962e4d93dca208509bb9.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_0be315b88930962e4d93dca208509bb9.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_8f820c61f000936324e7cbf3a4da4824.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY61758> (referer: https://www.auto1.com/v1/car-details-view/TY61758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK51232> (referer: https://www.auto1.com/v1/car-details-view/ZK51232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf06a50>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg saved to cache
2026-03-27 12:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be18ee90>
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F88%252F8d886527907a213aa07db0d9473fd955%252Fpa%252FYU82988_93d44e385ae1490f59f1688e8d222774.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_93d44e385ae1490f59f1688e8d222774.jpg saved to cache
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b15081e2-0adb-56ce-968a-e014ad60e99a
2026-03-27 12:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b15081e2-0adb-56ce-968a-e014ad60e99a, skipping ID generation
2026-03-27 12:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b15081e2-0adb-56ce-968a-e014ad60e99a with scrape type 1
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b15081e2-0adb-56ce-968a-e014ad60e99a sending to next pipeline
2026-03-27 12:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b15081e2-0adb-56ce-968a-e014ad60e99a, identifier: YU82988
2026-03-27 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-27 12:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988
2026-03-27 12:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b15081e2-0adb-56ce-968a-e014ad60e99a with identifier: YU82988 to the API
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_93d44e385ae1490f59f1688e8d222774.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:46Z',
 'fuel_type': 'petrol',
 'id': 'b15081e2-0adb-56ce-968a-e014ad60e99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '30XJV7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU82988',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 117872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0a4bd7c36134eb9684b6625ab1d50abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_6aa9d20d904daa645f28f261b63dc0d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2149374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_93d44e385ae1490f59f1688e8d222774.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d839f1101b5a4694ae0e635055f0565e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_0e0efbe17277806df8412bae14bfece1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_fee9fbace15a425980c7bd983b6bc18a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_8a91431753b65c5aca87ac4b1cf19060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_d2b55c42295cbda37ea59bd0c317294d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_c7de3ad52370e83265b977d12ec1bff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15081e2-0adb-56ce-968a-e014ad60e99a/b15081e2-0adb-56ce-968a-e014ad60e99a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/88/8d886527907a213aa07db0d9473fd955/pa/YU82988_80e4910b7c37428a801813df4eccc016.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [auto1.nl] INFO: Saving data for YU82988: {'created_time': 1774612908.636753, 'last_price_update_time': 1774612908.636766, 'auction_closing_time': 1774714726.0}
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU82988') HTTP/1.1" 204 0
2026-03-27 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_67ee77f9678e25226d183c2dc1c02861.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-27 12:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23e57ec-1928-59dc-9d38-b84d16cd6859 with scrape type 1
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f23e57ec-1928-59dc-9d38-b84d16cd6859
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_41473b602f0e122dd6d37621ae57d992.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_41473b602f0e122dd6d37621ae57d992.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_cdffe5e6fe78578d7e0369acbe792fba.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cdffe5e6fe78578d7e0369acbe792fba.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_b7d301d9a161802eb8d1e52fda5b41b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_b7d301d9a161802eb8d1e52fda5b41b4.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_dcdc5186b32c06dbb60bb6d2b04aebe2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_dcdc5186b32c06dbb60bb6d2b04aebe2.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_58dd39e56ca68469640c06bea76bc71e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_58dd39e56ca68469640c06bea76bc71e.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_5d797b757dab79c8b61cd57de44a3575.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_5d797b757dab79c8b61cd57de44a3575.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_21b31cd008cf2ffd210caea7261a1702.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_21b31cd008cf2ffd210caea7261a1702.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_6853bc1fbf3fa71afe2cbb0a46479768.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_6853bc1fbf3fa71afe2cbb0a46479768.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_f18f9338475290958d81a705af301cb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_f18f9338475290958d81a705af301cb0.jpg already downloaded
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Fc4%252Fabc4aa8feec593f78917aa0d7703eb2e%252Fpa%252FGK86118_cfea48b6ab7620b77abbd526c4afea2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cfea48b6ab7620b77abbd526c4afea2a.jpg already downloaded
2026-03-27 12:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f23e57ec-1928-59dc-9d38-b84d16cd6859, identifier: GK86118
2026-03-27 12:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-27 12:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118
2026-03-27 12:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f23e57ec-1928-59dc-9d38-b84d16cd6859 with identifier: GK86118 to the API
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK86118>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': 'f23e57ec-1928-59dc-9d38-b84d16cd6859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TJ273F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK86118',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 62977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_41473b602f0e122dd6d37621ae57d992.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cdffe5e6fe78578d7e0369acbe792fba.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_b7d301d9a161802eb8d1e52fda5b41b4.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_dcdc5186b32c06dbb60bb6d2b04aebe2.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_58dd39e56ca68469640c06bea76bc71e.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_5d797b757dab79c8b61cd57de44a3575.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_21b31cd008cf2ffd210caea7261a1702.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_6853bc1fbf3fa71afe2cbb0a46479768.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_f18f9338475290958d81a705af301cb0.jpg',
                'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cfea48b6ab7620b77abbd526c4afea2a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_41473b602f0e122dd6d37621ae57d992.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cdffe5e6fe78578d7e0369acbe792fba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_b7d301d9a161802eb8d1e52fda5b41b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_dcdc5186b32c06dbb60bb6d2b04aebe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_58dd39e56ca68469640c06bea76bc71e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704829,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_5d797b757dab79c8b61cd57de44a3575.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_21b31cd008cf2ffd210caea7261a1702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_6853bc1fbf3fa71afe2cbb0a46479768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_f18f9338475290958d81a705af301cb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f23e57ec-1928-59dc-9d38-b84d16cd6859/f23e57ec-1928-59dc-9d38-b84d16cd6859_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/c4/abc4aa8feec593f78917aa0d7703eb2e/pa/GK86118_cfea48b6ab7620b77abbd526c4afea2a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [auto1.nl] INFO: Saving data for GK86118: {'created_time': 1774612909.369529, 'last_price_update_time': 1774612909.369547, 'auction_closing_time': 1774714609.0}
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GK86118') HTTP/1.1" 204 0
2026-03-27 12:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK51310> (referer: https://www.auto1.com/v1/car-details-view/DK51310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BZ34461> (referer: https://www.auto1.com/v1/car-details-view/BZ34461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea83e90>
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_9fa315edd322429ff9df7a40d3603067.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9fa315edd322429ff9df7a40d3603067.jpg saved to cache
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be055f90>
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_8f820c61f000936324e7cbf3a4da4824.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_8f820c61f000936324e7cbf3a4da4824.jpg saved to cache
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf25190>
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg saved to cache
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-27 12:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with scrape type 1
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0aeef802-f18a-50ad-bb65-7b97acd5ae62
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_6c521bcd2dd2b81eb3685acc30a4d3d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6c521bcd2dd2b81eb3685acc30a4d3d3.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_27687c62e629ebd32ae7944297451d77.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_27687c62e629ebd32ae7944297451d77.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_7f7f6ff4f43c7c62187e428faeff27cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_7f7f6ff4f43c7c62187e428faeff27cf.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_37d41c47f8fd2b5b22b50170f0764fe7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_37d41c47f8fd2b5b22b50170f0764fe7.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_e5770eabf33ded86e5f152633347870d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_e5770eabf33ded86e5f152633347870d.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_61be579c02c68877ea5ca803cb7c835a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_61be579c02c68877ea5ca803cb7c835a.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_da9b70bcd0c848dfe45fafe8d78b53ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_da9b70bcd0c848dfe45fafe8d78b53ba.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_6cc59ca1eb6ccd8719c15c8d1735e61b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6cc59ca1eb6ccd8719c15c8d1735e61b.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_38acb5c5c3039cdb459c9bd4275cc30b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_38acb5c5c3039cdb459c9bd4275cc30b.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe4%252F4ae49dce8a30687504a3d7c5214c457f%252Fpa%252FTY61758_3b4ae86adde56da3c69520d59b697587.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_3b4ae86adde56da3c69520d59b697587.jpg already downloaded
2026-03-27 12:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0aeef802-f18a-50ad-bb65-7b97acd5ae62, identifier: TY61758
2026-03-27 12:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-27 12:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac708c77-429d-538f-b6b1-e288c0cdccb5 with scrape type 1
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ac708c77-429d-538f-b6b1-e288c0cdccb5
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_0641ee33927aa3d304799b9255a5f7f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_0641ee33927aa3d304799b9255a5f7f2.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_df07b72329101eee2ee9f4a7e6f9a3dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_df07b72329101eee2ee9f4a7e6f9a3dc.jpg already downloaded
2026-03-27 12:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_cb106816fb62ae4b9dce5de780cca89b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_cb106816fb62ae4b9dce5de780cca89b.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_fa4378f2164a4d29ae91eb3d8c019a2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_fa4378f2164a4d29ae91eb3d8c019a2e.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_146fbf661b90e6bf940bcaf7b6fdb2e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_146fbf661b90e6bf940bcaf7b6fdb2e4.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_f00dcd5c40f62b8c0b6de4969b641cd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_f00dcd5c40f62b8c0b6de4969b641cd5.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_17fc99e51ad835aa8727a7cdfd8a23af.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_17fc99e51ad835aa8727a7cdfd8a23af.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_1e5abf9b4cdaa5e956bbd47130e04019.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1e5abf9b4cdaa5e956bbd47130e04019.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_1c0a2a20509aef072257f92476202679.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1c0a2a20509aef072257f92476202679.jpg already downloaded
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F8d%252Fec8d50d1b7d38aedc9d4a5beedfb5000%252Fpa%252FZK51232_767e020a7037bd9a332312cdc9826a27.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_767e020a7037bd9a332312cdc9826a27.jpg already downloaded
2026-03-27 12:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ac708c77-429d-538f-b6b1-e288c0cdccb5, identifier: ZK51232
2026-03-27 12:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be18c310>
2026-03-27 12:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg saved to cache
2026-03-27 12:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-27 12:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758
2026-03-27 12:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0aeef802-f18a-50ad-bb65-7b97acd5ae62 with identifier: TY61758 to the API
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY61758>
{'auction_title': '',
 'c_o_2_emission_value': 319,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '5.2L',
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:27:49Z',
 'fuel_type': 'petrol',
 'id': '0aeef802-f18a-50ad-bb65-7b97acd5ae62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P563FG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY61758',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 198388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6c521bcd2dd2b81eb3685acc30a4d3d3.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_27687c62e629ebd32ae7944297451d77.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_7f7f6ff4f43c7c62187e428faeff27cf.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_37d41c47f8fd2b5b22b50170f0764fe7.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_e5770eabf33ded86e5f152633347870d.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_61be579c02c68877ea5ca803cb7c835a.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_da9b70bcd0c848dfe45fafe8d78b53ba.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6cc59ca1eb6ccd8719c15c8d1735e61b.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_38acb5c5c3039cdb459c9bd4275cc30b.jpg',
                'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_3b4ae86adde56da3c69520d59b697587.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6c521bcd2dd2b81eb3685acc30a4d3d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_27687c62e629ebd32ae7944297451d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516571,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_7f7f6ff4f43c7c62187e428faeff27cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2343965,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_37d41c47f8fd2b5b22b50170f0764fe7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_e5770eabf33ded86e5f152633347870d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2426332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_61be579c02c68877ea5ca803cb7c835a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292907,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_da9b70bcd0c848dfe45fafe8d78b53ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2536807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_6cc59ca1eb6ccd8719c15c8d1735e61b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_38acb5c5c3039cdb459c9bd4275cc30b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aeef802-f18a-50ad-bb65-7b97acd5ae62/0aeef802-f18a-50ad-bb65-7b97acd5ae62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e4/4ae49dce8a30687504a3d7c5214c457f/pa/TY61758_3b4ae86adde56da3c69520d59b697587.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S6 5.2 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [auto1.nl] INFO: Saving data for TY61758: {'created_time': 1774612910.645523, 'last_price_update_time': 1774612910.645534, 'auction_closing_time': 1774715269.0}
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY61758') HTTP/1.1" 204 0
2026-03-27 12:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-27 12:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232
2026-03-27 12:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ac708c77-429d-538f-b6b1-e288c0cdccb5 with identifier: ZK51232 to the API
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK51232>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:55:12Z',
 'fuel_type': 'petrol',
 'id': 'ac708c77-429d-538f-b6b1-e288c0cdccb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '99TPH2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK51232',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 72544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_0641ee33927aa3d304799b9255a5f7f2.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_df07b72329101eee2ee9f4a7e6f9a3dc.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_cb106816fb62ae4b9dce5de780cca89b.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_fa4378f2164a4d29ae91eb3d8c019a2e.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_146fbf661b90e6bf940bcaf7b6fdb2e4.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_f00dcd5c40f62b8c0b6de4969b641cd5.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_17fc99e51ad835aa8727a7cdfd8a23af.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1e5abf9b4cdaa5e956bbd47130e04019.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1c0a2a20509aef072257f92476202679.jpg',
                'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_767e020a7037bd9a332312cdc9826a27.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_0641ee33927aa3d304799b9255a5f7f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1998426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_df07b72329101eee2ee9f4a7e6f9a3dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2119581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_cb106816fb62ae4b9dce5de780cca89b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1847495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_fa4378f2164a4d29ae91eb3d8c019a2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2140926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_146fbf661b90e6bf940bcaf7b6fdb2e4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2107677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_f00dcd5c40f62b8c0b6de4969b641cd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_17fc99e51ad835aa8727a7cdfd8a23af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1e5abf9b4cdaa5e956bbd47130e04019.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1936439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_1c0a2a20509aef072257f92476202679.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ac708c77-429d-538f-b6b1-e288c0cdccb5/ac708c77-429d-538f-b6b1-e288c0cdccb5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2026084,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/8d/ec8d50d1b7d38aedc9d4a5beedfb5000/pa/ZK51232_767e020a7037bd9a332312cdc9826a27.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2012}
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-27 12:01:50 [auto1.nl] INFO: Saving data for ZK51232: {'created_time': 1774612910.992465, 'last_price_update_time': 1774612910.992479, 'auction_closing_time': 1774716912.0}
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK51232') HTTP/1.1" 204 0
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed62010>
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F9a%252Fc69a1956a612ef1cbf87211f29e1559c%252Fpa%252FFU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg saved to cache
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c
2026-03-27 12:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c, skipping ID generation
2026-03-27 12:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with scrape type 1
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6296cd2c-5077-56d2-a288-7c9dc3d0df5c sending to next pipeline
2026-03-27 12:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c, identifier: FU31497
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0aa290>
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_67ee77f9678e25226d183c2dc1c02861.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_67ee77f9678e25226d183c2dc1c02861.jpg saved to cache
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-27 12:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497
2026-03-27 12:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6296cd2c-5077-56d2-a288-7c9dc3d0df5c with identifier: FU31497 to the API
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'petrol',
 'id': '6296cd2c-5077-56d2-a288-7c9dc3d0df5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'R803BK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU31497',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 101593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_aa2f8ea961f8103c4210ba5c8bed37cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7a42238ee706998326a212d2fe96045d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_74e947fa649d081e1ffa53f3c90bf4ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_25b6e36eea728ea92153f0c601823023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_0811b4c24e5632c0a1006e2f01f6a724.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_6603fd9c348a5568f6c87ef91c404163.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_ad853655a2ebac916ae9a6cdd402e4a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_7ccca0f0d66ae1f7f49c7119ed0d2099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_b13c5032511ba5516a3e00a65a366889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6296cd2c-5077-56d2-a288-7c9dc3d0df5c/6296cd2c-5077-56d2-a288-7c9dc3d0df5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/9a/c69a1956a612ef1cbf87211f29e1559c/pa/FU31497_d165a4212bff1ba47db7eb7bf7cf5b19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [auto1.nl] INFO: Saving data for FU31497: {'created_time': 1774612911.617417, 'last_price_update_time': 1774612911.617426, 'auction_closing_time': 1774715706.0}
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU31497') HTTP/1.1" 204 0
2026-03-27 12:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-27 12:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a7b7fb-5c83-58b3-9132-e13daed78825 with scrape type 1
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_f472bdf33194f4b73ae4d935ed007a31.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_f472bdf33194f4b73ae4d935ed007a31.jpg not downloaded yet
2026-03-27 12:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-27 12:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d52b8792-fb43-5a09-aad8-ec4816df7017 with scrape type 1
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d52b8792-fb43-5a09-aad8-ec4816df7017
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_0eca3ca553ea4f18df7029bff14171ed.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_0eca3ca553ea4f18df7029bff14171ed.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_b18e34b53adff9cd297cb89548547a11.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_b18e34b53adff9cd297cb89548547a11.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_d704ee3bce4f2db5d758b5ff9ba18cc0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_d704ee3bce4f2db5d758b5ff9ba18cc0.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_11bdb2a42cbfd04d785e79e85d3a27f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_11bdb2a42cbfd04d785e79e85d3a27f0.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_13087aa4aa149a6e7eb6b86ce812c43d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_13087aa4aa149a6e7eb6b86ce812c43d.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_9a52380e5c89d95508c65becd906202c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_9a52380e5c89d95508c65becd906202c.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_68150300c04d0e07678d07aa0ec529f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_68150300c04d0e07678d07aa0ec529f2.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_af2fdb632b6fecd5a4686793ca7f01ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_af2fdb632b6fecd5a4686793ca7f01ba.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_83259015549b95a8123180be516b4373.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_83259015549b95a8123180be516b4373.jpg already downloaded
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fc1%252F48c121bf9824e990fafe2f3eb1480377%252Fpa%252FBZ34461_34418febe3e19cf83af71c50c627b841.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_34418febe3e19cf83af71c50c627b841.jpg already downloaded
2026-03-27 12:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d52b8792-fb43-5a09-aad8-ec4816df7017, identifier: BZ34461
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_ed653633650786b9dc50674d4abbadbc.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_d07a2cc36187dcde8da603563d38e427.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-27 12:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461
2026-03-27 12:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d52b8792-fb43-5a09-aad8-ec4816df7017 with identifier: BZ34461 to the API
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BZ34461>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:43:14Z',
 'fuel_type': 'hybrid',
 'id': 'd52b8792-fb43-5a09-aad8-ec4816df7017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P007HG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ34461',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_0eca3ca553ea4f18df7029bff14171ed.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_b18e34b53adff9cd297cb89548547a11.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_d704ee3bce4f2db5d758b5ff9ba18cc0.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_11bdb2a42cbfd04d785e79e85d3a27f0.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_13087aa4aa149a6e7eb6b86ce812c43d.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_9a52380e5c89d95508c65becd906202c.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_68150300c04d0e07678d07aa0ec529f2.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_af2fdb632b6fecd5a4686793ca7f01ba.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_83259015549b95a8123180be516b4373.jpg',
                'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_34418febe3e19cf83af71c50c627b841.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2766826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_0eca3ca553ea4f18df7029bff14171ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755388,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_b18e34b53adff9cd297cb89548547a11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_d704ee3bce4f2db5d758b5ff9ba18cc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_11bdb2a42cbfd04d785e79e85d3a27f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481840,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_13087aa4aa149a6e7eb6b86ce812c43d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2692682,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_9a52380e5c89d95508c65becd906202c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2432112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_68150300c04d0e07678d07aa0ec529f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_af2fdb632b6fecd5a4686793ca7f01ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_83259015549b95a8123180be516b4373.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d52b8792-fb43-5a09-aad8-ec4816df7017/d52b8792-fb43-5a09-aad8-ec4816df7017_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2714243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img48/c1/48c121bf9824e990fafe2f3eb1480377/pa/BZ34461_34418febe3e19cf83af71c50c627b841.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-27 12:01:52 [auto1.nl] INFO: Saving data for BZ34461: {'created_time': 1774612912.421671, 'last_price_update_time': 1774612912.421681, 'auction_closing_time': 1774716194.0}
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ34461') HTTP/1.1" 204 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_2a3f907a75920d14399a6f1882ed03ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_2a3f907a75920d14399a6f1882ed03ae.jpg not downloaded yet
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf81210>
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg saved to cache
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_088b206afbe601766b46bc865e848f26.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_3595124bb2155df83d1a0221a9827d69.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_3595124bb2155df83d1a0221a9827d69.jpg not downloaded yet
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb0510>
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252Fc8%252Fd6c829f4fdcbf21a57a4a124155ff1ab%252Fpa%252FNF23683_ed653633650786b9dc50674d4abbadbc.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_ed653633650786b9dc50674d4abbadbc.jpg saved to cache
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab
2026-03-27 12:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab, skipping ID generation
2026-03-27 12:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with scrape type 1
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab sending to next pipeline
2026-03-27 12:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab, identifier: NF23683
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb2b10>
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_d07a2cc36187dcde8da603563d38e427.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_d07a2cc36187dcde8da603563d38e427.jpg saved to cache
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb3a9d0>
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg saved to cache
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea02590>
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg saved to cache
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_24a0bc5f12528b1583f9163cf5f82918.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg not downloaded yet
2026-03-27 12:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-27 12:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683
2026-03-27 12:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5bc5c40f-a752-5a49-9269-c9cd8c7a0bab with identifier: NF23683 to the API
2026-03-27 12:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_ed653633650786b9dc50674d4abbadbc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 2',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '5bc5c40f-a752-5a49-9269-c9cd8c7a0bab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SHHV83',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF23683',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 71757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_ed653633650786b9dc50674d4abbadbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_3b6228aefbdac457b45782f652aa4870.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_8f820c61f000936324e7cbf3a4da4824.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_13e00759eaba48554fba36a86e70e179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bc5c40f-a752-5a49-9269-c9cd8c7a0bab/5bc5c40f-a752-5a49-9269-c9cd8c7a0bab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/c8/d6c829f4fdcbf21a57a4a124155ff1ab/pa/NF23683_67ee77f9678e25226d183c2dc1c02861.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1997-10-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 1997}
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-27 12:01:53 [auto1.nl] INFO: Saving data for NF23683: {'created_time': 1774612913.286393, 'last_price_update_time': 1774612913.286404, 'auction_closing_time': 1774714786.0}
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF23683') HTTP/1.1" 204 0
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_ff275f17183b41432641bbde3feeb0f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_19a0e9576b4170a278ffd50769787965.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_19a0e9576b4170a278ffd50769787965.jpg not downloaded yet
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU10821/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1ed850>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec3d950>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_088b206afbe601766b46bc865e848f26.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_088b206afbe601766b46bc865e848f26.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf49750>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_24a0bc5f12528b1583f9163cf5f82918.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_24a0bc5f12528b1583f9163cf5f82918.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf1da90>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_ff275f17183b41432641bbde3feeb0f8.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_ff275f17183b41432641bbde3feeb0f8.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb38d90>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb1390>
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F74%252Fbb74179e1c963fd36b8b24040f92632d%252Fpa%252FAB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg saved to cache
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a731edc4-4823-5ae3-96c0-2c82d02c85fd
2026-03-27 12:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a731edc4-4823-5ae3-96c0-2c82d02c85fd, skipping ID generation
2026-03-27 12:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a731edc4-4823-5ae3-96c0-2c82d02c85fd with scrape type 1
2026-03-27 12:01:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a731edc4-4823-5ae3-96c0-2c82d02c85fd sending to next pipeline
2026-03-27 12:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a731edc4-4823-5ae3-96c0-2c82d02c85fd, identifier: AB92284
2026-03-27 12:01:53 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1060 | hits on page: 40
2026-03-27 12:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a731edc4-4823-5ae3-96c0-2c82d02c85fd with identifier: AB92284
2026-03-27 12:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a731edc4-4823-5ae3-96c0-2c82d02c85fd with identifier: AB92284
2026-03-27 12:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a731edc4-4823-5ae3-96c0-2c82d02c85fd with identifier: AB92284 to the API
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:07:42Z',
 'fuel_type': 'diesel',
 'id': 'a731edc4-4823-5ae3-96c0-2c82d02c85fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'VDK08Z',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB92284',
 'listing': 'auction',
 'location': 'NL, Dordrecht',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 106291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_4b9571e31674a2b73ccd6e4566573589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_ff6a27c480ef5e73ff8ae5c00eb730a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1bd2b9a0d010b7428b274015f6d20d42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_1d90ffbc42f8742952397168a5cabc82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_24a0bc5f12528b1583f9163cf5f82918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 389531,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_0a079a6c465b3bb9676576dad50e32d2.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_bd19a0a1279c29c5d2a87ed79cd5fe30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 385148,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_002939f34eb8d7f49ab1017bd69fbaaf.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_088b206afbe601766b46bc865e848f26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a731edc4-4823-5ae3-96c0-2c82d02c85fd/a731edc4-4823-5ae3-96c0-2c82d02c85fd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 368315,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/74/bb74179e1c963fd36b8b24040f92632d/pa/AB92284_5d9a10bb9c2198196f7a8a7d7cbdaa53.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-21',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L3H3 GKa 3,5t',
 'transmission': 'manual',
 'trim': 'L3H3 GKa 3,5t',
 'year': 2019}
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB92284%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Saving data for AB92284: {'created_time': 1774612914.399436, 'last_price_update_time': 1774612914.399453, 'auction_closing_time': 1774714062.0}
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB92284') HTTP/1.1" 204 0
2026-03-27 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_f472bdf33194f4b73ae4d935ed007a31.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_f6473a5545b08d440c2250057f06d269.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for ZT03654: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for EZ41839: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for GT27619: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for PJ49676: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: MC16226
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: FA22053
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for BF79856: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for DA17330: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for CN01691: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: DS12857
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: JA63213
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: XX17303
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XX17303%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for XX17303: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: MA10228
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for GC72456: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: GW12777
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW12777%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for GW12777: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for XS82099: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: VB20382
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: SA24792
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: NM22595
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PN74472
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN74472%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for PN74472: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: HR81591
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR81591%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for HR81591: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for LH74130: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for CH03360: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for PH10928: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for AV65488: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for ED59845: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: BC68713
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC68713%27 HTTP/1.1" 200 None
2026-03-27 12:01:54 [auto1.nl] INFO: Scrape type for BC68713: 0
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: KJ58786
2026-03-27 12:01:54 [auto1.nl] INFO: Found listing with ID: BK15232
2026-03-27 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_2a3f907a75920d14399a6f1882ed03ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_3595124bb2155df83d1a0221a9827d69.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb8de50>
2026-03-27 12:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F31%252Fc331d7e725175ec6ecc8f7e7354b5ad7%252Fpa%252FJJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg saved to cache
2026-03-27 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03c1213c-d41e-50a7-a447-856ac758f05b
2026-03-27 12:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03c1213c-d41e-50a7-a447-856ac758f05b, skipping ID generation
2026-03-27 12:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03c1213c-d41e-50a7-a447-856ac758f05b with scrape type 1
2026-03-27 12:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03c1213c-d41e-50a7-a447-856ac758f05b sending to next pipeline
2026-03-27 12:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03c1213c-d41e-50a7-a447-856ac758f05b, identifier: JJ87309
2026-03-27 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ44063> (referer: https://www.auto1.com/v1/car-details-view/ZZ44063/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-27 12:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309
2026-03-27 12:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03c1213c-d41e-50a7-a447-856ac758f05b with identifier: JJ87309 to the API
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'diesel',
 'id': '03c1213c-d41e-50a7-a447-856ac758f05b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ87309',
 'listing': 'auction',
 'location': 'NL',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 256243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_ab7997486e6438f8b71f950c57875132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_f74a0a649f27963ed90ab62bf38d6a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_33207ead1c4a0706ab87a1f18fff7b6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_2bc2710e1b56aabce989ded63f9d712e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c58228cd2bcfdf7c7cb159d50125857f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_8177c3daf1456e36c7ddc7c166dd44ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_6b56af7b364905f1fe7db36323142078.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_9011985f661396e562e735f725aa2404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_bf11dba3390ca6aac61638abe40a0517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_03c1213c-d41e-50a7-a447-856ac758f05b/03c1213c-d41e-50a7-a447-856ac758f05b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/31/c331d7e725175ec6ecc8f7e7354b5ad7/pa/JJ87309_c9c17cfabe63263ba3ea86815c772829.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-27 12:01:55 [auto1.nl] INFO: Saving data for JJ87309: {'created_time': 1774612915.625626, 'last_price_update_time': 1774612915.625639, 'auction_closing_time': 1774715359.0}
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ87309') HTTP/1.1" 204 0
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becab810>
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_f472bdf33194f4b73ae4d935ed007a31.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_f472bdf33194f4b73ae4d935ed007a31.jpg saved to cache
2026-03-27 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb95110>
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F55%252F1e550b3593ff8a3ad2c305bb8a86f8d5%252Fpa%252FUS57687_f6473a5545b08d440c2250057f06d269.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_f6473a5545b08d440c2250057f06d269.jpg saved to cache
2026-03-27 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1a83e27d-321a-5d90-9779-1e29536a61c2
2026-03-27 12:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1a83e27d-321a-5d90-9779-1e29536a61c2, skipping ID generation
2026-03-27 12:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a83e27d-321a-5d90-9779-1e29536a61c2 with scrape type 1
2026-03-27 12:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1a83e27d-321a-5d90-9779-1e29536a61c2 sending to next pipeline
2026-03-27 12:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a83e27d-321a-5d90-9779-1e29536a61c2, identifier: US57687
2026-03-27 12:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_2d6150015137918216abec7b9e1078bf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-27 12:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 12:01:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687
2026-03-27 12:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a83e27d-321a-5d90-9779-1e29536a61c2 with identifier: US57687 to the API
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_f6473a5545b08d440c2250057f06d269.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:32:46Z',
 'fuel_type': 'electro',
 'id': '1a83e27d-321a-5d90-9779-1e29536a61c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US57687',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 52816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60250,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_0a01387c504f3c0784a223f1f81c8c3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59887,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_f6473a5545b08d440c2250057f06d269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58550,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_c689fd1d816a0ce5f16788ad18c48b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 458727,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_a090b08a6b130f0af97f6b1130d2c92d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44845,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_cf26098d1af93fd9e95bd87b1d586503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135581,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_d81df98e219ff4d90e45674532ba8d76.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35594,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_14d7b2f7495df3a17507e43f42f9b892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a83e27d-321a-5d90-9779-1e29536a61c2/1a83e27d-321a-5d90-9779-1e29536a61c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31824,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/55/1e550b3593ff8a3ad2c305bb8a86f8d5/pa/US57687_3e6701df1156045546f1d04d27e5f105.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 electric drive 100 kW Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-27 12:01:56 [auto1.nl] INFO: Saving data for US57687: {'created_time': 1774612916.453957, 'last_price_update_time': 1774612916.453966, 'auction_closing_time': 1774715566.0}
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='US57687') HTTP/1.1" 204 0
2026-03-27 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_57aa78cb0bf2b9a8731008528bc87447.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_19a0e9576b4170a278ffd50769787965.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea4d5d0>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_2a3f907a75920d14399a6f1882ed03ae.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_2a3f907a75920d14399a6f1882ed03ae.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedd3550>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_3595124bb2155df83d1a0221a9827d69.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_3595124bb2155df83d1a0221a9827d69.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-27 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d93669-9311-5e31-a119-b799d480993c with scrape type 1
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg not downloaded yet
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_a347f817e6095c76004588b999565620.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_a347f817e6095c76004588b999565620.jpg not downloaded yet
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb94210>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Ff9%252F91f9b3304c62bb2fbd54bb2d44a70610%252Fpa%252FAB05434_2d6150015137918216abec7b9e1078bf.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_2d6150015137918216abec7b9e1078bf.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026
2026-03-27 12:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026, skipping ID generation
2026-03-27 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with scrape type 1
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 sending to next pipeline
2026-03-27 12:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026, identifier: AB05434
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be01efd0>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb95b10>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F61%252Faa612ab3d170ecff46108bb93c42cef8%252Fpa%252FPD24155_57aa78cb0bf2b9a8731008528bc87447.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_57aa78cb0bf2b9a8731008528bc87447.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e
2026-03-27 12:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e, skipping ID generation
2026-03-27 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with scrape type 1
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a85fc4b1-7efd-526b-9ac5-a5cb6113a84e sending to next pipeline
2026-03-27 12:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e, identifier: PD24155
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be196c50>
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fff%252Fc2ffa07f4d64ff25a711c102667d188a%252Fpa%252FDK51310_19a0e9576b4170a278ffd50769787965.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_19a0e9576b4170a278ffd50769787965.jpg saved to cache
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38a7b7fb-5c83-58b3-9132-e13daed78825
2026-03-27 12:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38a7b7fb-5c83-58b3-9132-e13daed78825, skipping ID generation
2026-03-27 12:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a7b7fb-5c83-58b3-9132-e13daed78825 with scrape type 1
2026-03-27 12:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38a7b7fb-5c83-58b3-9132-e13daed78825 sending to next pipeline
2026-03-27 12:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38a7b7fb-5c83-58b3-9132-e13daed78825, identifier: DK51310
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg not downloaded yet
2026-03-27 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-27 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434
2026-03-27 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026 with identifier: AB05434 to the API
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_2d6150015137918216abec7b9e1078bf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.2L',
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'petrol',
 'id': 'ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '26XFTX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05434',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 190937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_ec3b6c28f3f7e585ba360124324e7b1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_2d6150015137918216abec7b9e1078bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_8960c73e5d676f9fd9ac6c8631f2506e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_0bd8b8dbd039c2bd620ead32c99a22ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_87ca872c63d2e073c728f4c2b5e6c6f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a3549db195094eda1e4ba21675735f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_a0cd1838c21c7fad339ff004d34793f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_6015281fa26a9ff0e4b2b79e374e2fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_7bb3b69880b526527d14c3c7b1bcaa4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026/ce09cac4-d9e4-5171-a1d0-c8f4a7aa5026_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/f9/91f9b3304c62bb2fbd54bb2d44a70610/pa/AB05434_75ecde1cb6834ffb83df181b147967bb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 3.2 Momentum Geartronic',
 'transmission': 'automatic',
 'trim': 'Momentum Geartronic',
 'year': 2007}
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-27 12:01:57 [auto1.nl] INFO: Saving data for AB05434: {'created_time': 1774612917.479029, 'last_price_update_time': 1774612917.479041, 'auction_closing_time': 1774715706.0}
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB05434') HTTP/1.1" 204 0
2026-03-27 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-27 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155
2026-03-27 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a85fc4b1-7efd-526b-9ac5-a5cb6113a84e with identifier: PD24155 to the API
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_57aa78cb0bf2b9a8731008528bc87447.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': 'a85fc4b1-7efd-526b-9ac5-a5cb6113a84e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '35-NSN-7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD24155',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 274592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_39e7560ee97685cbac95da9d34dba074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_57aa78cb0bf2b9a8731008528bc87447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_68f5639101dda5c492125a92f7ccc811.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_87f83c980bba0bdb62590e0cea444cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a85fc4b1-7efd-526b-9ac5-a5cb6113a84e/a85fc4b1-7efd-526b-9ac5-a5cb6113a84e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/61/aa612ab3d170ecff46108bb93c42cef8/pa/PD24155_0ede020d64d649c35329e267b29d087b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-27 12:01:57 [auto1.nl] INFO: Saving data for PD24155: {'created_time': 1774612917.829419, 'last_price_update_time': 1774612917.82943, 'auction_closing_time': 1774714609.0}
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PD24155') HTTP/1.1" 204 0
2026-03-27 12:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-27 12:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310
2026-03-27 12:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38a7b7fb-5c83-58b3-9132-e13daed78825 with identifier: DK51310 to the API
2026-03-27 12:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_19a0e9576b4170a278ffd50769787965.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:23:24Z',
 'fuel_type': 'petrol',
 'id': '38a7b7fb-5c83-58b3-9132-e13daed78825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '78XNG2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51310',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 109984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_f472bdf33194f4b73ae4d935ed007a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_2a3f907a75920d14399a6f1882ed03ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_3595124bb2155df83d1a0221a9827d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_d5fa8bcf6d449e3c55a08846e50f7ee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38a7b7fb-5c83-58b3-9132-e13daed78825/38a7b7fb-5c83-58b3-9132-e13daed78825_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/ff/c2ffa07f4d64ff25a711c102667d188a/pa/DK51310_19a0e9576b4170a278ffd50769787965.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 Série Spéciale',
 'transmission': 'manual',
 'trim': 'Série Spéciale',
 'year': 2012}
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-27 12:01:58 [auto1.nl] INFO: Saving data for DK51310: {'created_time': 1774612918.28487, 'last_price_update_time': 1774612918.284882, 'auction_closing_time': 1774715004.0}
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK51310') HTTP/1.1" 204 0
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_885f6eb21d94b704693ea3548153f53d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_91ebdfd147fb30c5856912b5ef92117d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg not downloaded yet
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_a05f60d47d9412fa5de9632c1af27292.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg not downloaded yet
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_e01a86a1a0df49bb677b2352ed899245.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_b34877d1183a818eedb225f0733b2cd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be082fd0>
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_885f6eb21d94b704693ea3548153f53d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_885f6eb21d94b704693ea3548153f53d.jpg saved to cache
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_a347f817e6095c76004588b999565620.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea2f5d0>
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_91ebdfd147fb30c5856912b5ef92117d.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_91ebdfd147fb30c5856912b5ef92117d.jpg saved to cache
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec278d0>
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg saved to cache
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be19bf10>
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F32%252F96325c7c444bde4391b39b10e24f47dc%252Fpa%252FXR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg saved to cache
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec02c630-8f23-5a6c-8a53-96c910d17780
2026-03-27 12:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec02c630-8f23-5a6c-8a53-96c910d17780, skipping ID generation
2026-03-27 12:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec02c630-8f23-5a6c-8a53-96c910d17780 with scrape type 1
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec02c630-8f23-5a6c-8a53-96c910d17780 sending to next pipeline
2026-03-27 12:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec02c630-8f23-5a6c-8a53-96c910d17780, identifier: XR93243
2026-03-27 12:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be046910>
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fa1%252F0ba18394259c92c11dd8e2258a426ad4%252Fpa%252FSD33545_a05f60d47d9412fa5de9632c1af27292.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_a05f60d47d9412fa5de9632c1af27292.jpg saved to cache
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb68523d-d7ee-5239-af35-c043bb1fa1da
2026-03-27 12:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb68523d-d7ee-5239-af35-c043bb1fa1da, skipping ID generation
2026-03-27 12:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb68523d-d7ee-5239-af35-c043bb1fa1da with scrape type 1
2026-03-27 12:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb68523d-d7ee-5239-af35-c043bb1fa1da sending to next pipeline
2026-03-27 12:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb68523d-d7ee-5239-af35-c043bb1fa1da, identifier: SD33545
2026-03-27 12:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec02c630-8f23-5a6c-8a53-96c910d17780 with identifier: XR93243
2026-03-27 12:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec02c630-8f23-5a6c-8a53-96c910d17780 with identifier: XR93243
2026-03-27 12:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec02c630-8f23-5a6c-8a53-96c910d17780 with identifier: XR93243 to the API
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:08Z',
 'fuel_type': 'petrol',
 'id': 'ec02c630-8f23-5a6c-8a53-96c910d17780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K558NN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR93243',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 224128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_91ebdfd147fb30c5856912b5ef92117d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_05e59c3e3d933d5b2e57f396e905cc12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_836507d747ad80f0ed48e0ecb1ed4851.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_3ea2c1e01d07cff8b0ac838674e7fec4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec02c630-8f23-5a6c-8a53-96c910d17780/ec02c630-8f23-5a6c-8a53-96c910d17780_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/32/96325c7c444bde4391b39b10e24f47dc/pa/XR93243_338cf23b4f668a0f44aae1c2bbb5264c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 LX",
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2011}
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR93243%27 HTTP/1.1" 200 None
2026-03-27 12:01:59 [auto1.nl] INFO: Saving data for XR93243: {'created_time': 1774612919.289271, 'last_price_update_time': 1774612919.289282, 'auction_closing_time': 1774716368.0}
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR93243') HTTP/1.1" 204 0
2026-03-27 12:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-27 12:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545
2026-03-27 12:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb68523d-d7ee-5239-af35-c043bb1fa1da with identifier: SD33545 to the API
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_a05f60d47d9412fa5de9632c1af27292.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:03Z',
 'fuel_type': 'petrol',
 'id': 'fb68523d-d7ee-5239-af35-c043bb1fa1da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N689DJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD33545',
 'listing': 'auction',
 'location': 'NL, Amstelveen',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 111362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2421821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_74f617111d7b7bd26dcd0c86661c55f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_7eb1188181ee73ac38044fb6f706834a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2328508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9fa315edd322429ff9df7a40d3603067.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_0fcbf481d1a7cd23b4e431b3a3892e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_9014dff8695fa06b9a94a4b47863f221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_e5763af8b18ae3a94a7340a7c8b2dae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_5540e7e6dc7e26a461d768c56a490653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_a05f60d47d9412fa5de9632c1af27292.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_3e70b13d5815abdd748fe4e5f4b764a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb68523d-d7ee-5239-af35-c043bb1fa1da/fb68523d-d7ee-5239-af35-c043bb1fa1da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/a1/0ba18394259c92c11dd8e2258a426ad4/pa/SD33545_896f176fdeb7603d467c921053d5e4dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-27 12:01:59 [auto1.nl] INFO: Saving data for SD33545: {'created_time': 1774612919.676882, 'last_price_update_time': 1774612919.676893, 'auction_closing_time': 1774715823.0}
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD33545') HTTP/1.1" 204 0
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_3b41e80896fdb4f519e479870e8e500a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_e9d09cd938a859c040a59cc1edf71322.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_b72e816416f0ebf2d387b93186703eaf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_8a123f5f21cbe2fb01f51536364b112f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU10821> (referer: https://www.auto1.com/v1/car-details-view/TU10821/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PG46787/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becdab90>
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F77%252Fb777f5fab0079451df4a1ddaf05c89a9%252Fpa%252FWH69219_e01a86a1a0df49bb677b2352ed899245.jpg') HTTP/1.1" 204 0
2026-03-27 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_e01a86a1a0df49bb677b2352ed899245.jpg saved to cache
2026-03-27 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c82f516b-5659-5a1c-8ac5-9da25e80afaa
2026-03-27 12:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c82f516b-5659-5a1c-8ac5-9da25e80afaa, skipping ID generation
2026-03-27 12:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82f516b-5659-5a1c-8ac5-9da25e80afaa with scrape type 1
2026-03-27 12:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c82f516b-5659-5a1c-8ac5-9da25e80afaa sending to next pipeline
2026-03-27 12:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c82f516b-5659-5a1c-8ac5-9da25e80afaa, identifier: WH69219
2026-03-27 12:01:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be051550>
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F2d%252F832dfbadd934466d09bcb6debf46b4ba%252Fpa%252FLG57021_b34877d1183a818eedb225f0733b2cd4.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_b34877d1183a818eedb225f0733b2cd4.jpg saved to cache
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0862ad0-f3eb-504c-a902-f2ac95ab4200
2026-03-27 12:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0862ad0-f3eb-504c-a902-f2ac95ab4200, skipping ID generation
2026-03-27 12:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 with scrape type 1
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0862ad0-f3eb-504c-a902-f2ac95ab4200 sending to next pipeline
2026-03-27 12:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d0862ad0-f3eb-504c-a902-f2ac95ab4200, identifier: LG57021
2026-03-27 12:02:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be194d10>
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg saved to cache
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becd86d0>
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg saved to cache
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be082450>
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_a347f817e6095c76004588b999565620.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_a347f817e6095c76004588b999565620.jpg saved to cache
2026-03-27 12:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-27 12:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219
2026-03-27 12:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c82f516b-5659-5a1c-8ac5-9da25e80afaa with identifier: WH69219 to the API
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_e01a86a1a0df49bb677b2352ed899245.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:35:45Z',
 'fuel_type': 'hybrid',
 'id': 'c82f516b-5659-5a1c-8ac5-9da25e80afaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HN344F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH69219',
 'listing': 'auction',
 'location': 'NL, Tilburg',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 254498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c585bcf5092fcd46c3c4c83f6baef34b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_8dc3ba2f5a7f8d580e5e7700b83e935a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_e01a86a1a0df49bb677b2352ed899245.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_33616feda3d9dfebf928941469ab23cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_c5fa02d3e7bbcb392105b30791602f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_74659b50023f9a2bde5bc405e53a4d61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_a6daf2df3d10bd8251fe61c45723f6ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_bd9755cfc1a94ac1e9c6b37a3d480ec7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_0be315b88930962e4d93dca208509bb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82f516b-5659-5a1c-8ac5-9da25e80afaa/c82f516b-5659-5a1c-8ac5-9da25e80afaa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/77/b777f5fab0079451df4a1ddaf05c89a9/pa/WH69219_08ff9b2c8efcec6cb40e6b9e307dc4e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-27 12:02:00 [auto1.nl] INFO: Saving data for WH69219: {'created_time': 1774612920.729176, 'last_price_update_time': 1774612920.729188, 'auction_closing_time': 1774715745.0}
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH69219') HTTP/1.1" 204 0
2026-03-27 12:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-27 12:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021
2026-03-27 12:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d0862ad0-f3eb-504c-a902-f2ac95ab4200 with identifier: LG57021 to the API
2026-03-27 12:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_b34877d1183a818eedb225f0733b2cd4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:48:08Z',
 'fuel_type': 'petrol',
 'id': 'd0862ad0-f3eb-504c-a902-f2ac95ab4200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K-183-PK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG57021',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 156246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2515990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_09c45728983429338c36bc1c6854e67b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_5a789bdc0f5e7ea4b16f0c9b7d5e5d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_e6d6e750737927bd0c57e880a82f0bee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_b34877d1183a818eedb225f0733b2cd4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_37b119fb64d0e4fb8d436b789f3c9f7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_d07a2cc36187dcde8da603563d38e427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_f2b29feaaf1785e4f55175222b030691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_fe061e0dd7cac5963a978080c4ad9179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_ca85d43ac38e0efa00543b6f6363f81a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d0862ad0-f3eb-504c-a902-f2ac95ab4200/d0862ad0-f3eb-504c-a902-f2ac95ab4200_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/2d/832dfbadd934466d09bcb6debf46b4ba/pa/LG57021_2a6ba85f6b72f487a634ab0388b43e4c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2003}
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [auto1.nl] INFO: Saving data for LG57021: {'created_time': 1774612921.177823, 'last_price_update_time': 1774612921.177833, 'auction_closing_time': 1774716488.0}
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG57021') HTTP/1.1" 204 0
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea2e510>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebcb7d0>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_3b41e80896fdb4f519e479870e8e500a.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_3b41e80896fdb4f519e479870e8e500a.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beac1110>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_e9d09cd938a859c040a59cc1edf71322.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_e9d09cd938a859c040a59cc1edf71322.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb53e90>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_b72e816416f0ebf2d387b93186703eaf.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_b72e816416f0ebf2d387b93186703eaf.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb4e650>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be08d910>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F1e%252F901e0eebb97ea0cd73cf3ed838a6e581%252Fpa%252FFB63193_8a123f5f21cbe2fb01f51536364b112f.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_8a123f5f21cbe2fb01f51536364b112f.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc2a70d3-ef31-5641-b052-e688b6b845c0
2026-03-27 12:02:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc2a70d3-ef31-5641-b052-e688b6b845c0, skipping ID generation
2026-03-27 12:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc2a70d3-ef31-5641-b052-e688b6b845c0 with scrape type 1
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc2a70d3-ef31-5641-b052-e688b6b845c0 sending to next pipeline
2026-03-27 12:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc2a70d3-ef31-5641-b052-e688b6b845c0, identifier: FB63193
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea0eb90>
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg saved to cache
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-27 12:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with scrape type 1
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f612b92c-ca6f-5c6b-9312-41fbdee5d4a5
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_aa0cd5263a42fea1c39dfc6084cbd707.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_aa0cd5263a42fea1c39dfc6084cbd707.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_91ecceb7b2b451b7d4ca9869ffad36c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_91ecceb7b2b451b7d4ca9869ffad36c7.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_0d2fda56787b08c38d277c6b76a5ac1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0d2fda56787b08c38d277c6b76a5ac1f.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_fdfcbf6f0bd2c6cecc1816d6803e5465.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_fdfcbf6f0bd2c6cecc1816d6803e5465.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_9f2675d866cdc4e8b561036ad2e60d9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_9f2675d866cdc4e8b561036ad2e60d9d.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_c4943b030c849cee765b260349ea04b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_c4943b030c849cee765b260349ea04b4.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_0e9ae5f83a14ff318393b0c51b03d3dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0e9ae5f83a14ff318393b0c51b03d3dc.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_a76920eb7243ddf83be2d8c218b12ebf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_a76920eb7243ddf83be2d8c218b12ebf.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_2668221f9b689bc40f11d11e0f03a097.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_2668221f9b689bc40f11d11e0f03a097.jpg already downloaded
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252Fbf%252Faebffd4ec3d9ae911affb65e5bc923f7%252Fpa%252FTU10821_55061d4f66f0afcf45426c577dff7939.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_55061d4f66f0afcf45426c577dff7939.jpg already downloaded
2026-03-27 12:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5, identifier: TU10821
2026-03-27 12:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-27 12:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193
2026-03-27 12:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc2a70d3-ef31-5641-b052-e688b6b845c0 with identifier: FB63193 to the API
2026-03-27 12:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_8a123f5f21cbe2fb01f51536364b112f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:20Z',
 'fuel_type': 'petrol',
 'id': 'fc2a70d3-ef31-5641-b052-e688b6b845c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1XBX02',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB63193',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 235064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_6ade446f509c35e178c54ad1253ffed9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_55cb37acf38129b754e059bb20cc0738.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_8a123f5f21cbe2fb01f51536364b112f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_b72e816416f0ebf2d387b93186703eaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_d5d6c98903566be4e4f78d19a5bc52b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2624617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_58caee6bbd3f837c24d3fcfa25c2fbc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_87eca9b8250bccabfd8143676780d261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_e3d56c32bb2f265fcec6d3be599948d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_34c97e5b1aa3cb141fa3350ac12ad225.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc2a70d3-ef31-5641-b052-e688b6b845c0/fc2a70d3-ef31-5641-b052-e688b6b845c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/1e/901e0eebb97ea0cd73cf3ed838a6e581/pa/FB63193_bfe024ff6cf07cd54fba2f87e7522326.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TGI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2014}
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-27 12:02:02 [auto1.nl] INFO: Saving data for FB63193: {'created_time': 1774612922.279587, 'last_price_update_time': 1774612922.279599, 'auction_closing_time': 1774715000.0}
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB63193') HTTP/1.1" 204 0
2026-03-27 12:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-27 12:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821
2026-03-27 12:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f612b92c-ca6f-5c6b-9312-41fbdee5d4a5 with identifier: TU10821 to the API
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU10821>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:28:30Z',
 'fuel_type': 'hybrid',
 'id': 'f612b92c-ca6f-5c6b-9312-41fbdee5d4a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KV-476-S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU10821',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_aa0cd5263a42fea1c39dfc6084cbd707.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_91ecceb7b2b451b7d4ca9869ffad36c7.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0d2fda56787b08c38d277c6b76a5ac1f.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_fdfcbf6f0bd2c6cecc1816d6803e5465.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_9f2675d866cdc4e8b561036ad2e60d9d.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_c4943b030c849cee765b260349ea04b4.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0e9ae5f83a14ff318393b0c51b03d3dc.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_a76920eb7243ddf83be2d8c218b12ebf.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_2668221f9b689bc40f11d11e0f03a097.jpg',
                'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_55061d4f66f0afcf45426c577dff7939.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_aa0cd5263a42fea1c39dfc6084cbd707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_91ecceb7b2b451b7d4ca9869ffad36c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0d2fda56787b08c38d277c6b76a5ac1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_fdfcbf6f0bd2c6cecc1816d6803e5465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_9f2675d866cdc4e8b561036ad2e60d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_c4943b030c849cee765b260349ea04b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_0e9ae5f83a14ff318393b0c51b03d3dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_a76920eb7243ddf83be2d8c218b12ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_2668221f9b689bc40f11d11e0f03a097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f612b92c-ca6f-5c6b-9312-41fbdee5d4a5/f612b92c-ca6f-5c6b-9312-41fbdee5d4a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/bf/aebffd4ec3d9ae911affb65e5bc923f7/pa/TU10821_55061d4f66f0afcf45426c577dff7939.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-27 12:02:02 [auto1.nl] INFO: Saving data for TU10821: {'created_time': 1774612922.618508, 'last_price_update_time': 1774612922.618518, 'auction_closing_time': 1774715310.0}
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU10821') HTTP/1.1" 204 0
2026-03-27 12:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_ec79606840c3b08e281fc0d38fd4845d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0192e7a61b8c36f103d16805fa55712a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_d8ec5d0fbcd8f1700389025db408a123.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb38cd0>
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_ec79606840c3b08e281fc0d38fd4845d.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_ec79606840c3b08e281fc0d38fd4845d.jpg saved to cache
2026-03-27 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_7484e2b086d33f3359efa2f6e36125f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_cdb838a41789953117e55bbb2e21ad41.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdfe4810>
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F99%252F1299cdc0e5bbba9ee543fe996bc0a5e3%252Fpa%252FZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg saved to cache
2026-03-27 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d1d93669-9311-5e31-a119-b799d480993c
2026-03-27 12:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d1d93669-9311-5e31-a119-b799d480993c, skipping ID generation
2026-03-27 12:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1d93669-9311-5e31-a119-b799d480993c with scrape type 1
2026-03-27 12:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d1d93669-9311-5e31-a119-b799d480993c sending to next pipeline
2026-03-27 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d1d93669-9311-5e31-a119-b799d480993c, identifier: ZZ44063
2026-03-27 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_56d23963d09c3ab3475390c4aba362aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-27 12:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063
2026-03-27 12:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d1d93669-9311-5e31-a119-b799d480993c with identifier: ZZ44063 to the API
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:57Z',
 'fuel_type': 'petrol',
 'id': 'd1d93669-9311-5e31-a119-b799d480993c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NH162R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ44063',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 150822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_ff5d56088d0cc0a5b59e3bd815d16429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_a347f817e6095c76004588b999565620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_5692a94ddc66a564dfc17297f6dc31bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_996635bc0124b75a84a231cb5a009fd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d1d93669-9311-5e31-a119-b799d480993c/d1d93669-9311-5e31-a119-b799d480993c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/99/1299cdc0e5bbba9ee543fe996bc0a5e3/pa/ZZ44063_bc915446affd172fb9cf5f164fc5ba60.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2012}
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-27 12:02:03 [auto1.nl] INFO: Saving data for ZZ44063: {'created_time': 1774612923.406041, 'last_price_update_time': 1774612923.406052, 'auction_closing_time': 1774715397.0}
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ44063') HTTP/1.1" 204 0
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea53650>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_0192e7a61b8c36f103d16805fa55712a.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0192e7a61b8c36f103d16805fa55712a.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beca89d0>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC66376> (referer: https://www.auto1.com/v1/car-details-view/ZC66376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be069410>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_d8ec5d0fbcd8f1700389025db408a123.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_d8ec5d0fbcd8f1700389025db408a123.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed5acd0>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf667d0>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga8%252Fc2%252Fa8c2b0b6358790b55a435745da82c833%252Fpa%252FHX62169_7484e2b086d33f3359efa2f6e36125f1.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_7484e2b086d33f3359efa2f6e36125f1.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76
2026-03-27 12:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76, skipping ID generation
2026-03-27 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with scrape type 1
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 sending to next pipeline
2026-03-27 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76, identifier: HX62169
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0db990>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4bbb210>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F59%252Fac5916c567eefcb4aed4f6b99a389ac3%252Fpa%252FWS58210_cdb838a41789953117e55bbb2e21ad41.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_cdb838a41789953117e55bbb2e21ad41.jpg saved to cache
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 801aae17-b240-55c5-a7ff-feed6976a1dc
2026-03-27 12:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 801aae17-b240-55c5-a7ff-feed6976a1dc, skipping ID generation
2026-03-27 12:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 801aae17-b240-55c5-a7ff-feed6976a1dc with scrape type 1
2026-03-27 12:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 801aae17-b240-55c5-a7ff-feed6976a1dc sending to next pipeline
2026-03-27 12:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 801aae17-b240-55c5-a7ff-feed6976a1dc, identifier: WS58210
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beca8fd0>
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg saved to cache
2026-03-27 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beab5810>
2026-03-27 12:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F4b%252Fdf4b7d6d86a5019e6e0eead19b780103%252Fpa%252FDB38176_56d23963d09c3ab3475390c4aba362aa.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_56d23963d09c3ab3475390c4aba362aa.jpg saved to cache
2026-03-27 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1a139de-77db-5b67-accc-7706ed1ca697
2026-03-27 12:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1a139de-77db-5b67-accc-7706ed1ca697, skipping ID generation
2026-03-27 12:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1a139de-77db-5b67-accc-7706ed1ca697 with scrape type 1
2026-03-27 12:02:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1a139de-77db-5b67-accc-7706ed1ca697 sending to next pipeline
2026-03-27 12:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1a139de-77db-5b67-accc-7706ed1ca697, identifier: DB38176
2026-03-27 12:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ45732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-27 12:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169
2026-03-27 12:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc33c8e7-9d6c-57ac-b25b-14f09f86fa76 with identifier: HX62169 to the API
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_7484e2b086d33f3359efa2f6e36125f1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:11:23Z',
 'fuel_type': 'petrol',
 'id': 'fc33c8e7-9d6c-57ac-b25b-14f09f86fa76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RR510S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX62169',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 122332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_d6aed847840657fcd642a0fd409a17e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_a30a41a73466ead3b58266a401eaf984.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_011f3e43cfac31508bfef4d2c02eb69a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_bcdd0af97f313940828871ec22bb5894.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_7484e2b086d33f3359efa2f6e36125f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_e9d09cd938a859c040a59cc1edf71322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_3b41e80896fdb4f519e479870e8e500a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_885f6eb21d94b704693ea3548153f53d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_ff275f17183b41432641bbde3feeb0f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc33c8e7-9d6c-57ac-b25b-14f09f86fa76/fc33c8e7-9d6c-57ac-b25b-14f09f86fa76_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga8/c2/a8c2b0b6358790b55a435745da82c833/pa/HX62169_0c51c5d796604702b2c1864a01953a87.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2016}
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-27 12:02:04 [auto1.nl] INFO: Saving data for HX62169: {'created_time': 1774612924.529413, 'last_price_update_time': 1774612924.529422, 'auction_closing_time': 1774714283.0}
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX62169') HTTP/1.1" 204 0
2026-03-27 12:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-27 12:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210
2026-03-27 12:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 801aae17-b240-55c5-a7ff-feed6976a1dc with identifier: WS58210 to the API
2026-03-27 12:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_cdb838a41789953117e55bbb2e21ad41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'electro',
 'id': '801aae17-b240-55c5-a7ff-feed6976a1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS58210',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 51655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58076,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_ec79606840c3b08e281fc0d38fd4845d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56940,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_0de3778c0d9f78cb822c2a6d1549fe99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56298,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_cdb838a41789953117e55bbb2e21ad41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 459934,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_f642e9d03ddd5a2c717aa67bce429b2d.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39513,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_d266ec27ff6ca244fd86089fcf6ea274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_801aae17-b240-55c5-a7ff-feed6976a1dc/801aae17-b240-55c5-a7ff-feed6976a1dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35047,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/59/ac5916c567eefcb4aed4f6b99a389ac3/pa/WS58210_2f90230f26834b73b38989acbd073914.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 107 kW Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2022}
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-27 12:02:05 [auto1.nl] INFO: Saving data for WS58210: {'created_time': 1774612925.667135, 'last_price_update_time': 1774612925.667146, 'auction_closing_time': 1774716588.0}
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS58210') HTTP/1.1" 204 0
2026-03-27 12:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1a139de-77db-5b67-accc-7706ed1ca697 with identifier: DB38176
2026-03-27 12:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1a139de-77db-5b67-accc-7706ed1ca697 with identifier: DB38176
2026-03-27 12:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1a139de-77db-5b67-accc-7706ed1ca697 with identifier: DB38176 to the API
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_56d23963d09c3ab3475390c4aba362aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:39:42Z',
 'fuel_type': 'petrol',
 'id': 'a1a139de-77db-5b67-accc-7706ed1ca697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87LTS5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB38176',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 107339,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_56d23963d09c3ab3475390c4aba362aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_da81a4fd7e295a0b0f7415e685a9af84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_d8ec5d0fbcd8f1700389025db408a123.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_833e13da3a3edb693127e3302857cf54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_a18a71614f79ce90e5ce0d6316ea4813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_0e8d31875c7a4dacacc873fe0abe223d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_325dc1dbd0c10b9f9c103ce9421a553b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_e726c9e0211dbf0c8984f2701ba7068c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_2108be6597484e9f0d11ff3b7397652a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1a139de-77db-5b67-accc-7706ed1ca697/a1a139de-77db-5b67-accc-7706ed1ca697_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/4b/df4b7d6d86a5019e6e0eead19b780103/pa/DB38176_fde122ff6853146ff943567e7d9414f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2010}
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB38176%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [auto1.nl] INFO: Saving data for DB38176: {'created_time': 1774612926.077923, 'last_price_update_time': 1774612926.077934, 'auction_closing_time': 1774715982.0}
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB38176') HTTP/1.1" 204 0
2026-03-27 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PG46787> (referer: https://www.auto1.com/v1/car-details-view/PG46787/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT73125> (referer: https://www.auto1.com/v1/car-details-view/VT73125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF55872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdf5f810>
2026-03-27 12:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252Ff9%252F1bf9e1f0d94f96158c0c391eb8af8d0d%252Fpa%252FYJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg saved to cache
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 238907a7-1980-5280-a945-a254e51275e0
2026-03-27 12:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 238907a7-1980-5280-a945-a254e51275e0, skipping ID generation
2026-03-27 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238907a7-1980-5280-a945-a254e51275e0 with scrape type 1
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 238907a7-1980-5280-a945-a254e51275e0 sending to next pipeline
2026-03-27 12:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 238907a7-1980-5280-a945-a254e51275e0, identifier: YJ25285
2026-03-27 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-27 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 1
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_3bd5a7592da274968cefb27de02b43b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_3bd5a7592da274968cefb27de02b43b9.jpg not downloaded yet
2026-03-27 12:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 238907a7-1980-5280-a945-a254e51275e0 with identifier: YJ25285
2026-03-27 12:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 238907a7-1980-5280-a945-a254e51275e0 with identifier: YJ25285
2026-03-27 12:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 238907a7-1980-5280-a945-a254e51275e0 with identifier: YJ25285 to the API
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:59Z',
 'fuel_type': 'petrol',
 'id': '238907a7-1980-5280-a945-a254e51275e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '53ZHZZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ25285',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 245004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0979be85b5d262b9a206ada9d1fe2215.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_0192e7a61b8c36f103d16805fa55712a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_5c89f53e10af8350ddbc160f0b61f3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6518cddb2108d3fdcd76be1370f199b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_238907a7-1980-5280-a945-a254e51275e0/238907a7-1980-5280-a945-a254e51275e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/f9/1bf9e1f0d94f96158c0c391eb8af8d0d/pa/YJ25285_6f99e1ffac4e7d29b8ea6926a9b8b694.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2008}
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ25285%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [auto1.nl] INFO: Saving data for YJ25285: {'created_time': 1774612926.777024, 'last_price_update_time': 1774612926.777035, 'auction_closing_time': 1774713839.0}
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YJ25285') HTTP/1.1" 204 0
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg not downloaded yet
2026-03-27 12:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-27 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 1
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg not downloaded yet
2026-03-27 12:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-27 12:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a125890-abcc-5834-b7b0-59af188eb17e with scrape type 1
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 0a125890-abcc-5834-b7b0-59af188eb17e
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F7d%252F1e7d06a9a974ded8ca1a73429deb23de%252Fpa%252FVT73125_5403e9c0424b7d85dc6bdada822cd21c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_5403e9c0424b7d85dc6bdada822cd21c.jpg already downloaded
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F7d%252F1e7d06a9a974ded8ca1a73429deb23de%252Fpa%252FVT73125_42a8f846696363e26ab49527f304338b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_42a8f846696363e26ab49527f304338b.jpg already downloaded
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F7d%252F1e7d06a9a974ded8ca1a73429deb23de%252Fpa%252FVT73125_92240b7263bcd769842f2eb204c99581.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_92240b7263bcd769842f2eb204c99581.jpg already downloaded
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F7d%252F1e7d06a9a974ded8ca1a73429deb23de%252Fpa%252FVT73125_0a7054efdd44caeb2af6ae940ff3083a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_0a7054efdd44caeb2af6ae940ff3083a.jpg already downloaded
2026-03-27 12:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a125890-abcc-5834-b7b0-59af188eb17e, identifier: VT73125
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_615743c327905b8c86cea70fef9292bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_615743c327905b8c86cea70fef9292bc.jpg not downloaded yet
2026-03-27 12:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-27 12:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125
2026-03-27 12:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a125890-abcc-5834-b7b0-59af188eb17e with identifier: VT73125 to the API
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT73125>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:22:28Z',
 'fuel_type': 'petrol',
 'id': '0a125890-abcc-5834-b7b0-59af188eb17e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PD750K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT73125',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 263692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_5403e9c0424b7d85dc6bdada822cd21c.jpg',
                'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_42a8f846696363e26ab49527f304338b.jpg',
                'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_92240b7263bcd769842f2eb204c99581.jpg',
                'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_0a7054efdd44caeb2af6ae940ff3083a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a125890-abcc-5834-b7b0-59af188eb17e/0a125890-abcc-5834-b7b0-59af188eb17e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_5403e9c0424b7d85dc6bdada822cd21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a125890-abcc-5834-b7b0-59af188eb17e/0a125890-abcc-5834-b7b0-59af188eb17e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_42a8f846696363e26ab49527f304338b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a125890-abcc-5834-b7b0-59af188eb17e/0a125890-abcc-5834-b7b0-59af188eb17e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_92240b7263bcd769842f2eb204c99581.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a125890-abcc-5834-b7b0-59af188eb17e/0a125890-abcc-5834-b7b0-59af188eb17e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/7d/1e7d06a9a974ded8ca1a73429deb23de/pa/VT73125_0a7054efdd44caeb2af6ae940ff3083a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2010}
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Saving data for VT73125: {'created_time': 1774612927.420134, 'last_price_update_time': 1774612927.420148, 'auction_closing_time': 1774714948.0}
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VT73125') HTTP/1.1" 204 0
2026-03-27 12:02:07 [scrapy.extensions.logstats] INFO: Crawled 107 pages (at 56 pages/min), scraped 92 items (at 70 items/min)
2026-03-27 12:02:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg not downloaded yet
2026-03-27 12:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg not downloaded yet
2026-03-27 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_3bd5a7592da274968cefb27de02b43b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg not downloaded yet
2026-03-27 12:02:07 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_7204ce2791b2eb636db2c31597fba392.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_7204ce2791b2eb636db2c31597fba392.jpg not downloaded yet
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg not downloaded yet
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SB79167
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB79167%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for SB79167: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for HU61188: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: GT38548
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38548%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for GT38548: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for MC36011: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: ZM40656
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: AU66208
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU66208%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for AU66208: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: DD20442
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD20442%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for DD20442: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: AM12843
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM12843%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for AM12843: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for HT16373: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for WV31023: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: MC01443
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: GJ39127
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ39127%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for GJ39127: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for CP01462: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SG20975
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SG77636
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG77636%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for SG77636: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: CZ22404
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for TL32110: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for LN57581: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for ZZ83139: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: ZE62663
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: JK78904
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SE52210
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for SY25778: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for TD45630: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: AY95318
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY95318%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for AY95318: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: SB09763
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [auto1.nl] INFO: Scrape type for JX67409: 0
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-27 12:02:07 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-27 12:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_60ec262385b9af38f212e51774913d16.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_60ec262385b9af38f212e51774913d16.jpg not downloaded yet
2026-03-27 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_615743c327905b8c86cea70fef9292bc.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be129ad0>
2026-03-27 12:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_3bd5a7592da274968cefb27de02b43b9.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_3bd5a7592da274968cefb27de02b43b9.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_4640a4189711298bd75a1c70cf3f30cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_0f430aedc05885471e6ab1ec9116243d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_0f430aedc05885471e6ab1ec9116243d.jpg not downloaded yet
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_be767c701725afec273c47a5a911df85.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_be767c701725afec273c47a5a911df85.jpg not downloaded yet
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_9201db52b1fa85aea68033bcc3c55528.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_9201db52b1fa85aea68033bcc3c55528.jpg not downloaded yet
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be129090>
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_ad843003005a837a21463d7205318324.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_ad843003005a837a21463d7205318324.jpg not downloaded yet
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_7204ce2791b2eb636db2c31597fba392.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec83f10>
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_615743c327905b8c86cea70fef9292bc.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_615743c327905b8c86cea70fef9292bc.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be12a550>
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_540dfa1a000fb9b2543f40904dfc613c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_540dfa1a000fb9b2543f40904dfc613c.jpg not downloaded yet
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_60ec262385b9af38f212e51774913d16.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becba590>
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F5b%252Fc45bd55fd91ae761307fff282d8c3542%252Fpa%252FAA56023_4640a4189711298bd75a1c70cf3f30cd.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_4640a4189711298bd75a1c70cf3f30cd.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069
2026-03-27 12:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0090e5ea-dc74-53b5-bcb9-85c7a357b069, skipping ID generation
2026-03-27 12:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with scrape type 1
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0090e5ea-dc74-53b5-bcb9-85c7a357b069 sending to next pipeline
2026-03-27 12:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0090e5ea-dc74-53b5-bcb9-85c7a357b069, identifier: AA56023
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1a6910>
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg saved to cache
2026-03-27 12:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_0f430aedc05885471e6ab1ec9116243d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-27 12:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023
2026-03-27 12:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0090e5ea-dc74-53b5-bcb9-85c7a357b069 with identifier: AA56023 to the API
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_4640a4189711298bd75a1c70cf3f30cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:08:47Z',
 'fuel_type': 'petrol',
 'id': '0090e5ea-dc74-53b5-bcb9-85c7a357b069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JP868J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA56023',
 'listing': 'auction',
 'location': 'NL, Leiderdorp',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 137494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2141801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a902338e00f05e81b6c2916ede5601e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2150418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_4640a4189711298bd75a1c70cf3f30cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_a5a4281d8c3f4fd609e4e6b2f7fab022.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1967239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2b1e6f997c4feeb1cd6e07a80eb26324.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_2775c22c07a4f36c1ec9f19554547d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_51eb48ed15eee26906887a413c1e9ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_f75f05081cb1a1f0b170efa3fea1308f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_6bfe738eee44c9423c1ffd0de4974470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_5fb1b3927bd9e1fd573e9bb95a072f4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0090e5ea-dc74-53b5-bcb9-85c7a357b069/0090e5ea-dc74-53b5-bcb9-85c7a357b069_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/5b/c45bd55fd91ae761307fff282d8c3542/pa/AA56023_500eb0d05b9ba5b935cb550f042f4e79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-27 12:02:09 [auto1.nl] INFO: Saving data for AA56023: {'created_time': 1774612929.080075, 'last_price_update_time': 1774612929.080086, 'auction_closing_time': 1774714127.0}
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA56023') HTTP/1.1" 204 0
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb314d0>
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F44%252F714472e1d0c7f2c79a23d37a5bef605c%252Fpa%252FZC66376_7204ce2791b2eb636db2c31597fba392.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_7204ce2791b2eb636db2c31597fba392.jpg saved to cache
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e694759e-81bc-546a-b3b5-4a98c30a5836
2026-03-27 12:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e694759e-81bc-546a-b3b5-4a98c30a5836, skipping ID generation
2026-03-27 12:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e694759e-81bc-546a-b3b5-4a98c30a5836 with scrape type 1
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e694759e-81bc-546a-b3b5-4a98c30a5836 sending to next pipeline
2026-03-27 12:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e694759e-81bc-546a-b3b5-4a98c30a5836, identifier: ZC66376
2026-03-27 12:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-27 12:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376
2026-03-27 12:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e694759e-81bc-546a-b3b5-4a98c30a5836 with identifier: ZC66376 to the API
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_7204ce2791b2eb636db2c31597fba392.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:38:17Z',
 'fuel_type': 'petrol',
 'id': 'e694759e-81bc-546a-b3b5-4a98c30a5836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KB088X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC66376',
 'listing': 'auction',
 'location': 'NL, Gouda',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 167083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_3bd5a7592da274968cefb27de02b43b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_a7e5f174c10aaccb70f9070ca8050211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_615743c327905b8c86cea70fef9292bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_6be99b345a3811a3d9ab4413fbdb9fea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e694759e-81bc-546a-b3b5-4a98c30a5836/e694759e-81bc-546a-b3b5-4a98c30a5836_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/44/714472e1d0c7f2c79a23d37a5bef605c/pa/ZC66376_7204ce2791b2eb636db2c31597fba392.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-27 12:02:09 [auto1.nl] INFO: Saving data for ZC66376: {'created_time': 1774612929.820288, 'last_price_update_time': 1774612929.8203, 'auction_closing_time': 1774715897.0}
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZC66376') HTTP/1.1" 204 0
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c5446990>
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_60ec262385b9af38f212e51774913d16.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_60ec262385b9af38f212e51774913d16.jpg saved to cache
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becae750>
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg saved to cache
2026-03-27 12:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becb1c90>
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_0f430aedc05885471e6ab1ec9116243d.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_0f430aedc05885471e6ab1ec9116243d.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF55872> (referer: https://www.auto1.com/v1/car-details-view/EF55872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_ad843003005a837a21463d7205318324.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_540dfa1a000fb9b2543f40904dfc613c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_be767c701725afec273c47a5a911df85.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_9201db52b1fa85aea68033bcc3c55528.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ45732> (referer: https://www.auto1.com/v1/car-details-view/TJ45732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:10 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: VF97157
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AU83967
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU83967%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for AU83967: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for AA68968: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: ZX00251
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00251%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for ZX00251: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: BG45201
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG45201%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for BG45201: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: HP34422
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for ZL96236: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: MA73251
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA73251%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for MA73251: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: RX88185
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for HC20329: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: KF17287
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF17287%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for KF17287: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: HJ57971
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: UU65175
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65175%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for UU65175: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: FN38553
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FN38553%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for FN38553: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: WC13329
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AM37738
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM37738%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for AM37738: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: BC52928
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC52928%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for BC52928: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: EZ08560
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for GT38970: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: PR00760
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: ZJ89710
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZJ89710%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for ZJ89710: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for WG43530: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: YZ79316
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ79316%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for YZ79316: 0
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: JD04628
2026-03-27 12:02:10 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [auto1.nl] INFO: Scrape type for YS44884: 0
2026-03-27 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with identifier: EF55872
2026-03-27 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with scrape type 1
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg not downloaded yet
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg not downloaded yet
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb8edd0>
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_ad843003005a837a21463d7205318324.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_ad843003005a837a21463d7205318324.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea0ee10>
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_540dfa1a000fb9b2543f40904dfc613c.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_540dfa1a000fb9b2543f40904dfc613c.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_228dbf2275ac983c60175a550745835e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_228dbf2275ac983c60175a550745835e.jpg not downloaded yet
2026-03-27 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bedb7fd0>
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3c4b73790>
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_be767c701725afec273c47a5a911df85.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_be767c701725afec273c47a5a911df85.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be0d6250>
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_9201db52b1fa85aea68033bcc3c55528.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_9201db52b1fa85aea68033bcc3c55528.jpg saved to cache
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b46b57f7-9c1f-5353-8add-53ef6c528bff with identifier: TJ45732
2026-03-27 12:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46b57f7-9c1f-5353-8add-53ef6c528bff with scrape type 1
2026-03-27 12:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_2f6cd43a7be498c206df68f499711385.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_2f6cd43a7be498c206df68f499711385.jpg not downloaded yet
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_0b492e00f5432e6609af47043a2361f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_0b492e00f5432e6609af47043a2361f0.jpg not downloaded yet
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg not downloaded yet
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg not downloaded yet
2026-03-27 12:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec34bd0>
2026-03-27 12:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252F1d%252F461dbaeea41ee019610e218fffef2c04%252Fpa%252FPG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg saved to cache
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f
2026-03-27 12:02:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f665fc60-c58f-5fd6-96ed-ce77a307ed1f, skipping ID generation
2026-03-27 12:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f with scrape type 1
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f665fc60-c58f-5fd6-96ed-ce77a307ed1f sending to next pipeline
2026-03-27 12:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f665fc60-c58f-5fd6-96ed-ce77a307ed1f, identifier: PG46787
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg not downloaded yet
2026-03-27 12:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-27 12:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787
2026-03-27 12:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f665fc60-c58f-5fd6-96ed-ce77a307ed1f with identifier: PG46787 to the API
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:40Z',
 'fuel_type': 'petrol',
 'id': 'f665fc60-c58f-5fd6-96ed-ce77a307ed1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '01SVT7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG46787',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 51364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2217682,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_025931cc83d657edf6d8d0cfafc5b98d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bb1a21ad17a961ef97affce6d3fd692d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_5f7b1498fc6f9cd99c9f8d37dd2a6f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2039148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_bba9f5b4a8ec86903190eae41a638fdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_60ec262385b9af38f212e51774913d16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_0f430aedc05885471e6ab1ec9116243d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2276046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_be767c701725afec273c47a5a911df85.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251147,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_9201db52b1fa85aea68033bcc3c55528.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_ad843003005a837a21463d7205318324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f665fc60-c58f-5fd6-96ed-ce77a307ed1f/f665fc60-c58f-5fd6-96ed-ce77a307ed1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/1d/461dbaeea41ee019610e218fffef2c04/pa/PG46787_540dfa1a000fb9b2543f40904dfc613c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Intense',
 'transmission': 'automatic',
 'trim': 'Intense',
 'year': 2011}
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [auto1.nl] INFO: Saving data for PG46787: {'created_time': 1774612931.822116, 'last_price_update_time': 1774612931.822127, 'auction_closing_time': 1774715260.0}
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG46787') HTTP/1.1" 204 0
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg not downloaded yet
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_f137c69b962058288cab212be0c3c66c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_f137c69b962058288cab212be0c3c66c.jpg not downloaded yet
2026-03-27 12:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_2f6cd43a7be498c206df68f499711385.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_0b492e00f5432e6609af47043a2361f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_228dbf2275ac983c60175a550745835e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_f137c69b962058288cab212be0c3c66c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bec36750>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bed63f50>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_2f6cd43a7be498c206df68f499711385.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_2f6cd43a7be498c206df68f499711385.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3be1e0890>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_0b492e00f5432e6609af47043a2361f0.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_0b492e00f5432e6609af47043a2361f0.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea02110>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beb42190>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_228dbf2275ac983c60175a550745835e.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_228dbf2275ac983c60175a550745835e.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3becf2cd0>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3beab6490>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bea02910>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252Fa5%252Fcea5a4fe4e4ae50f619a5db0eeefe0eb%252Fpa%252FEF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac
2026-03-27 12:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac, skipping ID generation
2026-03-27 12:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with scrape type 1
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dd7fbae-640a-5fc4-9ca9-82eea85816ac sending to next pipeline
2026-03-27 12:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac, identifier: EF55872
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bdfe61d0>
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg saved to cache
2026-03-27 12:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with identifier: EF55872
2026-03-27 12:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with identifier: EF55872
2026-03-27 12:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dd7fbae-640a-5fc4-9ca9-82eea85816ac with identifier: EF55872 to the API
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:00:53Z',
 'fuel_type': 'petrol',
 'id': '2dd7fbae-640a-5fc4-9ca9-82eea85816ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '80SGNK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF55872',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'BMW',
 'model': '3er',
 'odometer': 333260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_26e84a4152c8bc09db8fbd4c2107b721.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_d1cb9d75da736e432d720b5eefdee0cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_228dbf2275ac983c60175a550745835e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_0b492e00f5432e6609af47043a2361f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dd7fbae-640a-5fc4-9ca9-82eea85816ac/2dd7fbae-640a-5fc4-9ca9-82eea85816ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/a5/cea5a4fe4e4ae50f619a5db0eeefe0eb/pa/EF55872_2bc38e8da4d18badf0de1d998aac21b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Saving data for EF55872: {'created_time': 1774612933.070162, 'last_price_update_time': 1774612933.070175, 'auction_closing_time': 1774713653.0}
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EF55872') HTTP/1.1" 204 0
2026-03-27 12:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fc3bebc0c50>
2026-03-27 12:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fde%252F41de5ae0eaed7b2185bb81ac2b829b79%252Fpa%252FTJ45732_f137c69b962058288cab212be0c3c66c.jpg') HTTP/1.1" 204 0
2026-03-27 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_f137c69b962058288cab212be0c3c66c.jpg saved to cache
2026-03-27 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b46b57f7-9c1f-5353-8add-53ef6c528bff
2026-03-27 12:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b46b57f7-9c1f-5353-8add-53ef6c528bff, skipping ID generation
2026-03-27 12:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b46b57f7-9c1f-5353-8add-53ef6c528bff with scrape type 1
2026-03-27 12:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b46b57f7-9c1f-5353-8add-53ef6c528bff sending to next pipeline
2026-03-27 12:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b46b57f7-9c1f-5353-8add-53ef6c528bff, identifier: TJ45732
2026-03-27 12:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b46b57f7-9c1f-5353-8add-53ef6c528bff with identifier: TJ45732
2026-03-27 12:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b46b57f7-9c1f-5353-8add-53ef6c528bff with identifier: TJ45732
2026-03-27 12:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b46b57f7-9c1f-5353-8add-53ef6c528bff with identifier: TJ45732 to the API
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_f137c69b962058288cab212be0c3c66c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.1L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:43:38Z',
 'fuel_type': 'petrol',
 'id': 'b46b57f7-9c1f-5353-8add-53ef6c528bff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87ZKRK',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ45732',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 205542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_2f6cd43a7be498c206df68f499711385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_49a82fb94822201a2ab515d8ce5e8154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_4471159ff05a24bbb5e16ce7366b9877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_0d66cce797d2c6026e7c067aa6f8c01c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b46b57f7-9c1f-5353-8add-53ef6c528bff/b46b57f7-9c1f-5353-8add-53ef6c528bff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/de/41de5ae0eaed7b2185bb81ac2b829b79/pa/TJ45732_f137c69b962058288cab212be0c3c66c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2008}
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Saving data for TJ45732: {'created_time': 1774612933.602521, 'last_price_update_time': 1774612933.602539, 'auction_closing_time': 1774716218.0}
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TJ45732') HTTP/1.1" 204 0
2026-03-27 12:02:13 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: UP10954
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP10954%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for UP10954: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: LM91358
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM91358%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for LM91358: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: UR05111
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR05111%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for UR05111: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: FS52541
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS52541%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for FS52541: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: BD70921
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD70921%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for BD70921: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: XF96679
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: JY10471
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY10471%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for JY10471: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: GR34057
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR34057%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for GR34057: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: VK93798
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK93798%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for VK93798: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for VC90690: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: ZC98390
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC98390%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for ZC98390: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for CT33504: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: TV78325
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: BD34188
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD34188%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for BD34188: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: PB13683
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB13683%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for PB13683: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: DY04766
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY04766%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for DY04766: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: WA13538
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: VR98847
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR98847%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for VR98847: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-27 12:02:13 [auto1.nl] INFO: Scrape type for SD39656: 0
2026-03-27 12:02:13 [auto1.nl] INFO: Found listing with ID: ZS06916
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS06916%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for ZS06916: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for JJ43979: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: GW15283
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW15283%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for GW15283: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: FM74827
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for TV23834: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: DL89712
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: AW32002
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW32002%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for AW32002: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: ZV82416
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV82416%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for ZV82416: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-27 12:02:14 [auto1.nl] INFO: Scrape type for US61568: 0
2026-03-27 12:02:14 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-27 12:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:15 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: BJ91492
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ91492%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for BJ91492: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: BN62870
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN62870%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for BN62870: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: XK13830
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK13830%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for XK13830: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for TG85730: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: NT93332
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT93332%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for NT93332: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: RU64557
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for AY12537: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for XF65643: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: AK57667
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK57667%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for AK57667: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: NT74232
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: VB53474
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: NT44223
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: FU18655
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: FJ71499
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ71499%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for FJ71499: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: KR75756
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR75756%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for KR75756: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: CP38443
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP38443%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for CP38443: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for AY73779: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: LN50164
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for TG03602: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: DE05424
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: LT73586
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT73586%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for LT73586: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for JR01730: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: FW73564
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW73564%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for FW73564: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for YT29313: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: KY62085
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KY62085%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for KY62085: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: GC91066
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC91066%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for GC91066: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: TP82192
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP82192%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for TP82192: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: XS56409
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS56409%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for XS56409: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for RW09535: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for SL71745: 0
2026-03-27 12:02:15 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-27 12:02:15 [auto1.nl] INFO: Scrape type for HS40359: 0
2026-03-27 12:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:16 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for HX62268: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for HM04115: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: BR90130
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: ED28465
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED28465%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for ED28465: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: AA50190
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: DW60052
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for WM74497: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for GJ53353: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: TK52000
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK52000%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for TK52000: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: UR53095
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR53095%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for UR53095: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for VW91946: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: JB00487
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for KK04481: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for AN01630: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: PL05358
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: YH00240
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH00240%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for YH00240: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for TF74045: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for LX95579: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: PK96400
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for UE20026: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: NH87974
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH87974%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for NH87974: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: TR69611
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR69611%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for TR69611: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: RE93496
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RE93496%27 HTTP/1.1" 200 None
2026-03-27 12:02:16 [auto1.nl] INFO: Scrape type for RE93496: 0
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-27 12:02:16 [auto1.nl] INFO: Found listing with ID: YT86124
2026-03-27 12:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:18 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: RU52951
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RU52951%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for RU52951: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: JS69724
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: XP30676
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: NU02129
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: SX62443
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for VA53958: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: AN15968
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for SA56403: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: FN85022
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FN85022%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for FN85022: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for MF32327: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: AN32414
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: RF97563
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF97563%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for RF97563: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: CE86050
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for BE76328: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: ZY08342
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY08342%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for ZY08342: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: TT67624
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT67624%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for TT67624: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: MP73031
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: YR36694
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: RC52062
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC52062%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for RC52062: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: TW92220
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: UG37918
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG37918%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for UG37918: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for PU28768: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for VX18772: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-27 12:02:18 [auto1.nl] INFO: Scrape type for UJ17437: 0
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-27 12:02:18 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-27 12:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:19 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:19 [auto1.nl] INFO: Found listing with ID: SL35603
2026-03-27 12:02:19 [auto1.nl] INFO: Found listing with ID: JY08621
2026-03-27 12:02:19 [auto1.nl] INFO: Found listing with ID: AK29274
2026-03-27 12:02:19 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-27 12:02:19 [auto1.nl] INFO: Scrape type for EX94963: 2
2026-03-27 12:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d908709c-0fab-5a6e-bd1f-65d0e04313c5 with identifier: EX94963
2026-03-27 12:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d908709c-0fab-5a6e-bd1f-65d0e04313c5 with scrape type 2
2026-03-27 12:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d908709c-0fab-5a6e-bd1f-65d0e04313c5 with scrape type 2
2026-03-27 12:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d908709c-0fab-5a6e-bd1f-65d0e04313c5, identifier: EX94963
2026-03-27 12:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d908709c-0fab-5a6e-bd1f-65d0e04313c5 with identifier: EX94963
2026-03-27 12:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d908709c-0fab-5a6e-bd1f-65d0e04313c5 with identifier: EX94963
2026-03-27 12:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d908709c-0fab-5a6e-bd1f-65d0e04313c5 with identifier: EX94963 to the API
2026-03-27 12:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:04:25Z',
 'fuel_type': 'petrol',
 'id': 'd908709c-0fab-5a6e-bd1f-65d0e04313c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX94963',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 175692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Saving data for EX94963: {'auction_closing_time': 1774627465.0, 'created_time': 1773837330.373689, 'last_price_update_time': 1774612940.159316}
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX94963') HTTP/1.1" 204 0
2026-03-27 12:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for HH25512: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: CC64769
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for XG69964: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for EX49205: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for BF50619: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: SK27305
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK27305%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for SK27305: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: MY43312
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: MN03312
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for KM38195: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for NH92548: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for TV26065: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: SU79725
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU79725%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for SU79725: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for DW65450: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: MW94986
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for YT16121: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for PC64486: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-27 12:02:20 [auto1.nl] INFO: Scrape type for KT83574: 0
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: TF02101
2026-03-27 12:02:20 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-27 12:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:21 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: AT39158
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT39158%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for AT39158: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for UC11957: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UP97235
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP97235%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for UP97235: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: VN23813
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN23813%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for VN23813: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: XP09088
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: VE84801
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE84801%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for VE84801: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for NU05681: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UU42921
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: WP97111
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: EE19429
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE19429%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for EE19429: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for VS32339: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for LH67432: 0
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: WE20497
2026-03-27 12:02:21 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-27 12:02:21 [auto1.nl] INFO: Scrape type for BE07790: 2
2026-03-27 12:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76b1c0d-cc56-5926-84ed-165c464e47ac with identifier: BE07790
2026-03-27 12:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76b1c0d-cc56-5926-84ed-165c464e47ac with scrape type 2
2026-03-27 12:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f76b1c0d-cc56-5926-84ed-165c464e47ac with scrape type 2
2026-03-27 12:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f76b1c0d-cc56-5926-84ed-165c464e47ac, identifier: BE07790
2026-03-27 12:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f76b1c0d-cc56-5926-84ed-165c464e47ac with identifier: BE07790
2026-03-27 12:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f76b1c0d-cc56-5926-84ed-165c464e47ac with identifier: BE07790
2026-03-27 12:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f76b1c0d-cc56-5926-84ed-165c464e47ac with identifier: BE07790 to the API
2026-03-27 12:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:01:50Z',
 'fuel_type': 'diesel',
 'id': 'f76b1c0d-cc56-5926-84ed-165c464e47ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE07790',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 283817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-11',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Saving data for BE07790: {'auction_closing_time': 1774627310.0, 'created_time': 1774440076.233538, 'last_price_update_time': 1774612942.229904}
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BE07790') HTTP/1.1" 204 0
2026-03-27 12:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for ZB66825: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: TJ79570
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ79570%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for TJ79570: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for UC71604: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for XZ67857: 2
2026-03-27 12:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ae481c-7914-5d00-b4bc-421c5f119230 with identifier: XZ67857
2026-03-27 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ae481c-7914-5d00-b4bc-421c5f119230 with scrape type 2
2026-03-27 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ae481c-7914-5d00-b4bc-421c5f119230 with scrape type 2
2026-03-27 12:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1ae481c-7914-5d00-b4bc-421c5f119230, identifier: XZ67857
2026-03-27 12:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1ae481c-7914-5d00-b4bc-421c5f119230 with identifier: XZ67857
2026-03-27 12:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1ae481c-7914-5d00-b4bc-421c5f119230 with identifier: XZ67857
2026-03-27 12:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1ae481c-7914-5d00-b4bc-421c5f119230 with identifier: XZ67857 to the API
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:14:07Z',
 'fuel_type': 'diesel',
 'id': 'f1ae481c-7914-5d00-b4bc-421c5f119230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ67857',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 301897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-11',
 'seller_name': None,
 'title': 'Volvo C30 1.6 D2 Edition R-Design',
 'transmission': 'manual',
 'trim': 'Edition R-Design',
 'year': 2012}
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Saving data for XZ67857: {'auction_closing_time': 1774628047.0, 'created_time': 1774440055.970526, 'last_price_update_time': 1774612942.856174}
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XZ67857') HTTP/1.1" 204 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for DM27085: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for CP13228: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for ZN91004: 0
2026-03-27 12:02:22 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-27 12:02:22 [auto1.nl] INFO: Scrape type for KC58229: 2
2026-03-27 12:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-27 12:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de8ea18-8590-5418-81a7-d87b669a0a49 with scrape type 2
2026-03-27 12:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de8ea18-8590-5418-81a7-d87b669a0a49 with scrape type 2
2026-03-27 12:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3de8ea18-8590-5418-81a7-d87b669a0a49, identifier: KC58229
2026-03-27 12:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-27 12:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229
2026-03-27 12:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3de8ea18-8590-5418-81a7-d87b669a0a49 with identifier: KC58229 to the API
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:21:34Z',
 'fuel_type': 'petrol',
 'id': '3de8ea18-8590-5418-81a7-d87b669a0a49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC58229',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 221126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TGI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-27 12:02:23 [auto1.nl] INFO: Saving data for KC58229: {'auction_closing_time': 1774628494.0, 'created_time': 1774440047.522987, 'last_price_update_time': 1774612943.388795}
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC58229') HTTP/1.1" 204 0
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: EP42288
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP42288%27 HTTP/1.1" 200 None
2026-03-27 12:02:23 [auto1.nl] INFO: Scrape type for EP42288: 0
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: NX17950
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-27 12:02:23 [auto1.nl] INFO: Scrape type for UR86175: 0
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: VR96830
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR96830%27 HTTP/1.1" 200 None
2026-03-27 12:02:23 [auto1.nl] INFO: Scrape type for VR96830: 0
2026-03-27 12:02:23 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-27 12:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:27 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: DF40523
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF40523%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for DF40523: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: LZ72966
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for HY67553: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: CL26046
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL26046%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for CL26046: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: UC87539
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: BL93572
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL93572%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for BL93572: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: EH64437
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64437%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for EH64437: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: RP05834
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP05834%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for RP05834: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: VF41372
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for ZY63395: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for LF83736: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: GV22428
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: MU78869
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU78869%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for MU78869: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: AE96402
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE96402%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for AE96402: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for KC46486: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: XC02971
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: FH99485
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH99485%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for FH99485: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: EP67641
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: YA36223
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: YL08691
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YL08691%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for YL08691: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: HY06013
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for VG54194: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: SN92784
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN92784%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for SN92784: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: XC64033
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC64033%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for XC64033: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for FA42645: 0
2026-03-27 12:02:27 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-27 12:02:27 [auto1.nl] INFO: Scrape type for KZ79748: 2
2026-03-27 12:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a326d01-0ca3-504e-a416-0f5ad477c10e with identifier: KZ79748
2026-03-27 12:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a326d01-0ca3-504e-a416-0f5ad477c10e with scrape type 2
2026-03-27 12:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a326d01-0ca3-504e-a416-0f5ad477c10e with scrape type 2
2026-03-27 12:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2a326d01-0ca3-504e-a416-0f5ad477c10e, identifier: KZ79748
2026-03-27 12:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2a326d01-0ca3-504e-a416-0f5ad477c10e with identifier: KZ79748
2026-03-27 12:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2a326d01-0ca3-504e-a416-0f5ad477c10e with identifier: KZ79748
2026-03-27 12:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2a326d01-0ca3-504e-a416-0f5ad477c10e with identifier: KZ79748 to the API
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:50:52Z',
 'fuel_type': 'petrol',
 'id': '2a326d01-0ca3-504e-a416-0f5ad477c10e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ79748',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 145667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-22',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-27 12:02:28 [auto1.nl] INFO: Saving data for KZ79748: {'auction_closing_time': 1774630252.0, 'created_time': 1774440030.96038, 'last_price_update_time': 1774612948.360045}
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ79748') HTTP/1.1" 204 0
2026-03-27 12:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:28 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-27 12:02:28 [auto1.nl] INFO: Scrape type for TW17403: 0
2026-03-27 12:02:28 [auto1.nl] INFO: Found listing with ID: FF88979
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF88979%27 HTTP/1.1" 200 None
2026-03-27 12:02:28 [auto1.nl] INFO: Scrape type for FF88979: 0
2026-03-27 12:02:28 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-27 12:02:28 [auto1.nl] INFO: Scrape type for YK25571: 0
2026-03-27 12:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:29 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: CT83771
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for YF39374: 0
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: AN73809
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN73809%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for AN73809: 0
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: CA14360
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: HW54895
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW54895%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for HW54895: 0
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for GV74945: 0
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: VC25009
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC25009%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for VC25009: 0
2026-03-27 12:02:29 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-27 12:02:29 [auto1.nl] INFO: Scrape type for PL67988: 2
2026-03-27 12:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dccec0eb-aa2a-58cc-9ba4-da50babf30eb with identifier: PL67988
2026-03-27 12:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dccec0eb-aa2a-58cc-9ba4-da50babf30eb with scrape type 2
2026-03-27 12:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dccec0eb-aa2a-58cc-9ba4-da50babf30eb with scrape type 2
2026-03-27 12:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dccec0eb-aa2a-58cc-9ba4-da50babf30eb, identifier: PL67988
2026-03-27 12:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dccec0eb-aa2a-58cc-9ba4-da50babf30eb with identifier: PL67988
2026-03-27 12:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dccec0eb-aa2a-58cc-9ba4-da50babf30eb with identifier: PL67988
2026-03-27 12:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dccec0eb-aa2a-58cc-9ba4-da50babf30eb with identifier: PL67988 to the API
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-27T16:23:17Z',
 'fuel_type': 'hybrid',
 'id': 'dccec0eb-aa2a-58cc-9ba4-da50babf30eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL67988',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 85768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription Expression AWD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression AWD',
 'year': 2021}
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Saving data for PL67988: {'auction_closing_time': 1774628597.0, 'created_time': 1773429018.260044, 'last_price_update_time': 1774612950.102139}
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL67988') HTTP/1.1" 204 0
2026-03-27 12:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for ZK25360: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: HC35521
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: UY66824
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for NR57871: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: CU47397
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU47397%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for CU47397: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: FM53893
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: MP21260
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21260%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for MP21260: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: YW44964
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: UT70360
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT70360%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for UT70360: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: TB11511
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: CN24822
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: VJ51527
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: PZ78112
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ78112%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for PZ78112: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for YU59495: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: BC80219
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC80219%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for BC80219: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: CN55991
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-27 12:02:30 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-27 12:02:30 [auto1.nl] INFO: Found listing with ID: ZY75007
2026-03-27 12:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:31 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: KL60088
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL60088%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for KL60088: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: RJ98603
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ98603%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for RJ98603: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: AM83604
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: ZP65922
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: AH61195
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AH61195%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for AH61195: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: GE04989
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE04989%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for GE04989: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: NG66061
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG66061%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for NG66061: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: SG65266
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: MW87847
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: EA98995
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: PB45464
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for AL58798: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: KF20640
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF20640%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for KF20640: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for MW44280: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: JL94248
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL94248%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for JL94248: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: JU97585
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: ED96243
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: RT75688
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT75688%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for RT75688: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: JD50530
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD50530%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for JD50530: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for FS78045: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: RY08414
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY08414%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for RY08414: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: AE75222
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE75222%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for AE75222: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: WL86252
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL86252%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for WL86252: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for EV31817: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: RG75877
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: DH82187
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: ZG42486
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: FV20324
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: SY61768
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for YE49757: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: US07368
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US07368%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for US07368: 0
2026-03-27 12:02:31 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-27 12:02:31 [auto1.nl] INFO: Scrape type for LW17731: 0
2026-03-27 12:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:32 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: GM35453
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM35453%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for GM35453: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: RA55443
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: RH60258
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for CE26691: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: RC57684
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC57684%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for RC57684: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: FA02352
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA02352%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for FA02352: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: NG26580
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: ZW01223
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: FE52928
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: NH24631
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH24631%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for NH24631: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: US73773
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US73773%27 HTTP/1.1" 200 None
2026-03-27 12:02:32 [auto1.nl] INFO: Scrape type for US73773: 0
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: GL22662
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: ZB42112
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: UW51826
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-27 12:02:32 [auto1.nl] INFO: Found listing with ID: UV84373
2026-03-27 12:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV84373%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for UV84373: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: SV58198
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: ZA14076
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA14076%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for ZA14076: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: VU97147
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU97147%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for VU97147: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: RL05615
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for LH12020: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: MP73087
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for FW01389: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: DG50116
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for KR09014: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: MB22774
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB22774%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for MB22774: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: MR09185
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: EL93607
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL93607%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for EL93607: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: WH81007
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH81007%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for WH81007: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: SM93407
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM93407%27 HTTP/1.1" 200 None
2026-03-27 12:02:33 [auto1.nl] INFO: Scrape type for SM93407: 0
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: HK49609
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-27 12:02:33 [auto1.nl] INFO: Found listing with ID: TF60968
2026-03-27 12:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:34 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: CF21712
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: RL70309
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL70309%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for RL70309: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: HA11367
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA11367%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for HA11367: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: EW02836
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW02836%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for EW02836: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: XN26994
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XN26994%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for XN26994: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: SH43591
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for PS47079: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: RX84847
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: KM26805
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: TY10143
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: HH63171
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH63171%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for HH63171: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: HA66604
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: VR01331
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR01331%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for VR01331: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: CL07612
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL07612%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for CL07612: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: JY14630
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY14630%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for JY14630: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: FP91104
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP91104%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for FP91104: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: ZY13859
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY13859%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for ZY13859: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: VK83844
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: WU69480
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU69480%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for WU69480: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: DZ17172
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: EC94380
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC94380%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for EC94380: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: VM58472
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM58472%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for VM58472: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: FS28745
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS28745%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for FS28745: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: SV30356
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: CT46548
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for EG10969: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: KM02956
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM02956%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for KM02956: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: YV28666
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV28666%27 HTTP/1.1" 200 None
2026-03-27 12:02:34 [auto1.nl] INFO: Scrape type for YV28666: 0
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: KW55792
2026-03-27 12:02:34 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-27 12:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:40 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: NP98125
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: RH89754
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH89754%27 HTTP/1.1" 200 None
2026-03-27 12:02:40 [auto1.nl] INFO: Scrape type for RH89754: 0
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: ZG15483
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: AG60358
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG60358%27 HTTP/1.1" 200 None
2026-03-27 12:02:40 [auto1.nl] INFO: Scrape type for AG60358: 0
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: RJ35117
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: FC19497
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC19497%27 HTTP/1.1" 200 None
2026-03-27 12:02:40 [auto1.nl] INFO: Scrape type for FC19497: 0
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-27 12:02:40 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: MM63148
2026-03-27 12:02:40 [auto1.nl] INFO: Found listing with ID: JP27476
2026-03-27 12:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP27476%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for JP27476: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: DB35159
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB35159%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for DB35159: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for GS00430: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: VY67313
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: CV91211
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV91211%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for CV91211: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: PZ98334
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ98334%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for PZ98334: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: WV92196
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: UD77353
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: VJ98310
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ98310%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for VJ98310: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: KE35352
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: XJ29881
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ29881%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for XJ29881: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: ZN86859
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN86859%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for ZN86859: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: UN11563
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UN11563%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for UN11563: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: JR20080
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR20080%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for JR20080: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: BC93744
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC93744%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for BC93744: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: BF62657
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF62657%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for BF62657: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: BV93100
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV93100%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for BV93100: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: PL63147
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: GE68887
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: FL44315
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: VC25244
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: MX43508
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: BL87851
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: EG61372
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG61372%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for EG61372: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-27 12:02:41 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-27 12:02:41 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-27 12:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:42 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: PZ82543
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ82543%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for PZ82543: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: ZU52979
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for NR95179: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: SH85399
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: HN21627
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN21627%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for HN21627: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for WP19214: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: TA93955
2026-03-27 12:02:42 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-27 12:02:42 [auto1.nl] INFO: Scrape type for JC34887: 2
2026-03-27 12:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-27 12:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-27 12:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1d2e80-da32-5823-8172-6c9d1987bf83 with scrape type 2
2026-03-27 12:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bc1d2e80-da32-5823-8172-6c9d1987bf83, identifier: JC34887
2026-03-27 12:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-27 12:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887
2026-03-27 12:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bc1d2e80-da32-5823-8172-6c9d1987bf83 with identifier: JC34887 to the API
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:59:15Z',
 'fuel_type': 'petrol',
 'id': 'bc1d2e80-da32-5823-8172-6c9d1987bf83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC34887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 118986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-27 12:02:43 [auto1.nl] INFO: Saving data for JC34887: {'auction_closing_time': 1774630755.0, 'created_time': 1774526495.360027, 'last_price_update_time': 1774612963.319148}
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC34887') HTTP/1.1" 204 0
2026-03-27 12:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:43 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-27 12:02:43 [auto1.nl] INFO: Scrape type for YW81523: 2
2026-03-27 12:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-27 12:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-27 12:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382aef13-4829-597e-9f28-b53e227c1782 with scrape type 2
2026-03-27 12:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 382aef13-4829-597e-9f28-b53e227c1782, identifier: YW81523
2026-03-27 12:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-27 12:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523
2026-03-27 12:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 382aef13-4829-597e-9f28-b53e227c1782 with identifier: YW81523 to the API
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:50:18Z',
 'fuel_type': 'petrol',
 'id': '382aef13-4829-597e-9f28-b53e227c1782',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW81523',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 193516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-27 12:02:43 [auto1.nl] INFO: Saving data for YW81523: {'auction_closing_time': 1774630218.0, 'created_time': 1774526430.613596, 'last_price_update_time': 1774612963.836397}
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YW81523') HTTP/1.1" 204 0
2026-03-27 12:02:43 [auto1.nl] INFO: Found listing with ID: YF09192
2026-03-27 12:02:43 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-27 12:02:43 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-27 12:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:44 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:44 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-27 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-27 12:02:44 [auto1.nl] INFO: Scrape type for DV35318: 2
2026-03-27 12:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-27 12:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e8853b-e548-54d2-8665-a121fa7d131d with scrape type 2
2026-03-27 12:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e8853b-e548-54d2-8665-a121fa7d131d with scrape type 2
2026-03-27 12:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 41e8853b-e548-54d2-8665-a121fa7d131d, identifier: DV35318
2026-03-27 12:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-27 12:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318
2026-03-27 12:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 41e8853b-e548-54d2-8665-a121fa7d131d with identifier: DV35318 to the API
2026-03-27 12:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:49:28Z',
 'fuel_type': 'petrol',
 'id': '41e8853b-e548-54d2-8665-a121fa7d131d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV35318',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 72508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-27 12:02:45 [auto1.nl] INFO: Saving data for DV35318: {'auction_closing_time': 1774630168.0, 'created_time': 1773134425.158354, 'last_price_update_time': 1774612965.157069}
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DV35318') HTTP/1.1" 204 0
2026-03-27 12:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:45 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-27 12:02:45 [auto1.nl] INFO: Scrape type for XJ86601: 2
2026-03-27 12:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-27 12:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-27 12:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-27 12:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a74828f-287e-5201-9335-16a8f15c19f1, identifier: XJ86601
2026-03-27 12:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-27 12:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-27 12:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601 to the API
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-27T16:13:42Z',
 'fuel_type': 'petrol',
 'id': '1a74828f-287e-5201-9335-16a8f15c19f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ86601',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 102359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-27 12:02:45 [auto1.nl] INFO: Saving data for XJ86601: {'auction_closing_time': 1774628022.0, 'created_time': 1773301459.292838, 'last_price_update_time': 1774612965.553674}
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ86601') HTTP/1.1" 204 0
2026-03-27 12:02:45 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-27 12:02:45 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-27 12:02:45 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-27 12:02:45 [auto1.nl] INFO: Scrape type for TL29950: 2
2026-03-27 12:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-27 12:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-27 12:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with scrape type 2
2026-03-27 12:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba, identifier: TL29950
2026-03-27 12:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-27 12:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950
2026-03-27 12:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9b60e987-fe57-5b5c-a6d8-87cfa55627ba with identifier: TL29950 to the API
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:07:46Z',
 'fuel_type': 'diesel',
 'id': '9b60e987-fe57-5b5c-a6d8-87cfa55627ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL29950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 228514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2019}
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-27 12:02:45 [auto1.nl] INFO: Saving data for TL29950: {'auction_closing_time': 1774627666.0, 'created_time': 1774526497.448378, 'last_price_update_time': 1774612965.974837}
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL29950') HTTP/1.1" 204 0
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: CN71402
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN71402%27 HTTP/1.1" 200 None
2026-03-27 12:02:46 [auto1.nl] INFO: Scrape type for CN71402: 2
2026-03-27 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff5120f-717b-5996-a3ed-fa1bfd47622e with identifier: CN71402
2026-03-27 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff5120f-717b-5996-a3ed-fa1bfd47622e with scrape type 2
2026-03-27 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff5120f-717b-5996-a3ed-fa1bfd47622e with scrape type 2
2026-03-27 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bff5120f-717b-5996-a3ed-fa1bfd47622e, identifier: CN71402
2026-03-27 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bff5120f-717b-5996-a3ed-fa1bfd47622e with identifier: CN71402
2026-03-27 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bff5120f-717b-5996-a3ed-fa1bfd47622e with identifier: CN71402
2026-03-27 12:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bff5120f-717b-5996-a3ed-fa1bfd47622e with identifier: CN71402 to the API
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:03:35Z',
 'fuel_type': 'diesel',
 'id': 'bff5120f-717b-5996-a3ed-fa1bfd47622e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN71402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 306870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN71402%27 HTTP/1.1" 200 None
2026-03-27 12:02:46 [auto1.nl] INFO: Saving data for CN71402: {'auction_closing_time': 1774627415.0, 'created_time': 1774526503.967981, 'last_price_update_time': 1774612966.40431}
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CN71402') HTTP/1.1" 204 0
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-27 12:02:46 [auto1.nl] INFO: Scrape type for CD92062: 2
2026-03-27 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-27 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-27 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a32fc544-599c-5d4f-80c1-4427b167bb58 with scrape type 2
2026-03-27 12:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a32fc544-599c-5d4f-80c1-4427b167bb58, identifier: CD92062
2026-03-27 12:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-27 12:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062
2026-03-27 12:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a32fc544-599c-5d4f-80c1-4427b167bb58 with identifier: CD92062 to the API
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:24:49Z',
 'fuel_type': 'petrol',
 'id': 'a32fc544-599c-5d4f-80c1-4427b167bb58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD92062',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 194182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-02-09',
 'seller_name': None,
 'title': 'Volvo S40 2.4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2004}
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-27 12:02:46 [auto1.nl] INFO: Saving data for CD92062: {'auction_closing_time': 1774628689.0, 'created_time': 1774526490.094607, 'last_price_update_time': 1774612966.907489}
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD92062') HTTP/1.1" 204 0
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-27 12:02:46 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-27 12:02:46 [auto1.nl] INFO: Scrape type for HV97203: 2
2026-03-27 12:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-27 12:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-27 12:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-27 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea8f8866-2ba3-532b-9d03-849dcc7e2468, identifier: HV97203
2026-03-27 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-27 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-27 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203 to the API
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:16:45Z',
 'fuel_type': 'diesel',
 'id': 'ea8f8866-2ba3-532b-9d03-849dcc7e2468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV97203',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 240575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2015}
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-27 12:02:47 [auto1.nl] INFO: Saving data for HV97203: {'auction_closing_time': 1774628205.0, 'created_time': 1773229528.959622, 'last_price_update_time': 1774612967.33723}
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV97203') HTTP/1.1" 204 0
2026-03-27 12:02:47 [auto1.nl] INFO: Found listing with ID: ES15430
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES15430%27 HTTP/1.1" 200 None
2026-03-27 12:02:47 [auto1.nl] INFO: Scrape type for ES15430: 2
2026-03-27 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f829f56e-c78a-5176-89d4-19ccc76b1ea8 with identifier: ES15430
2026-03-27 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f829f56e-c78a-5176-89d4-19ccc76b1ea8 with scrape type 2
2026-03-27 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f829f56e-c78a-5176-89d4-19ccc76b1ea8 with scrape type 2
2026-03-27 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f829f56e-c78a-5176-89d4-19ccc76b1ea8, identifier: ES15430
2026-03-27 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f829f56e-c78a-5176-89d4-19ccc76b1ea8 with identifier: ES15430
2026-03-27 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f829f56e-c78a-5176-89d4-19ccc76b1ea8 with identifier: ES15430
2026-03-27 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f829f56e-c78a-5176-89d4-19ccc76b1ea8 with identifier: ES15430 to the API
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:28:30Z',
 'fuel_type': 'petrol',
 'id': 'f829f56e-c78a-5176-89d4-19ccc76b1ea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES15430',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 211642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES15430%27 HTTP/1.1" 200 None
2026-03-27 12:02:47 [auto1.nl] INFO: Saving data for ES15430: {'auction_closing_time': 1774628910.0, 'created_time': 1774526490.984976, 'last_price_update_time': 1774612967.75706}
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ES15430') HTTP/1.1" 204 0
2026-03-27 12:02:47 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-27 12:02:47 [auto1.nl] INFO: Scrape type for RT28324: 2
2026-03-27 12:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-27 12:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-27 12:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30da8169-e641-50bf-af5a-57af04ba4990 with scrape type 2
2026-03-27 12:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30da8169-e641-50bf-af5a-57af04ba4990, identifier: RT28324
2026-03-27 12:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-27 12:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324
2026-03-27 12:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30da8169-e641-50bf-af5a-57af04ba4990 with identifier: RT28324 to the API
2026-03-27 12:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:00:52Z',
 'fuel_type': 'petrol',
 'id': '30da8169-e641-50bf-af5a-57af04ba4990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT28324',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 50150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-27 12:02:48 [auto1.nl] INFO: Saving data for RT28324: {'auction_closing_time': 1774627252.0, 'created_time': 1774526506.285307, 'last_price_update_time': 1774612968.186602}
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT28324') HTTP/1.1" 204 0
2026-03-27 12:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:48 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-27 12:02:48 [auto1.nl] INFO: Scrape type for DM34469: 2
2026-03-27 12:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-27 12:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with scrape type 2
2026-03-27 12:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with scrape type 2
2026-03-27 12:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3, identifier: DM34469
2026-03-27 12:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 12:02:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469
2026-03-27 12:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3 with identifier: DM34469 to the API
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:21:55Z',
 'fuel_type': 'petrol',
 'id': 'a887a3e2-7f81-592f-8b9a-e3e1da2cbdd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM34469',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 153029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-02',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-27 12:02:48 [auto1.nl] INFO: Saving data for DM34469: {'auction_closing_time': 1774628515.0, 'created_time': 1774526485.470252, 'last_price_update_time': 1774612968.965524}
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DM34469') HTTP/1.1" 204 0
2026-03-27 12:02:48 [auto1.nl] INFO: Found listing with ID: RS24457
2026-03-27 12:02:48 [auto1.nl] INFO: Found listing with ID: CP05082
2026-03-27 12:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP05082%27 HTTP/1.1" 200 None
2026-03-27 12:02:49 [auto1.nl] INFO: Scrape type for CP05082: 2
2026-03-27 12:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with identifier: CP05082
2026-03-27 12:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with scrape type 2
2026-03-27 12:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with scrape type 2
2026-03-27 12:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 22f3430d-fc7f-56c6-afc9-bac04f9f41ce, identifier: CP05082
2026-03-27 12:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with identifier: CP05082
2026-03-27 12:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with identifier: CP05082
2026-03-27 12:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 22f3430d-fc7f-56c6-afc9-bac04f9f41ce with identifier: CP05082 to the API
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:03:48Z',
 'fuel_type': 'petrol',
 'id': '22f3430d-fc7f-56c6-afc9-bac04f9f41ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP05082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 186400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP05082%27 HTTP/1.1" 200 None
2026-03-27 12:02:49 [auto1.nl] INFO: Saving data for CP05082: {'auction_closing_time': 1774627428.0, 'created_time': 1774526488.524925, 'last_price_update_time': 1774612969.368918}
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP05082') HTTP/1.1" 204 0
2026-03-27 12:02:49 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:49 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-27 12:02:49 [auto1.nl] INFO: Found listing with ID: KT14617
2026-03-27 12:02:49 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-27 12:02:49 [auto1.nl] INFO: Scrape type for RY20438: 2
2026-03-27 12:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-27 12:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-27 12:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa245c6d-5eeb-53ca-8f47-b44339c58044 with scrape type 2
2026-03-27 12:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa245c6d-5eeb-53ca-8f47-b44339c58044, identifier: RY20438
2026-03-27 12:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-27 12:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438
2026-03-27 12:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa245c6d-5eeb-53ca-8f47-b44339c58044 with identifier: RY20438 to the API
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:08:08Z',
 'fuel_type': 'petrol',
 'id': 'fa245c6d-5eeb-53ca-8f47-b44339c58044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY20438',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 67852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-27 12:02:49 [auto1.nl] INFO: Saving data for RY20438: {'auction_closing_time': 1774627688.0, 'created_time': 1774526441.657556, 'last_price_update_time': 1774612969.800368}
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY20438') HTTP/1.1" 204 0
2026-03-27 12:02:49 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-27 12:02:49 [auto1.nl] INFO: Found listing with ID: JP85458
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP85458%27 HTTP/1.1" 200 None
2026-03-27 12:02:49 [auto1.nl] INFO: Scrape type for JP85458: 2
2026-03-27 12:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with identifier: JP85458
2026-03-27 12:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with scrape type 2
2026-03-27 12:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with scrape type 2
2026-03-27 12:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04d257f6-26ff-5513-98e9-fd73fa5df5a2, identifier: JP85458
2026-03-27 12:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:02:50 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-27 12:02:50 [auto1.nl] INFO: Scrape type for MW16655: 2
2026-03-27 12:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-27 12:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-27 12:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a035ded3-6a3d-5870-8819-bb065735b37f with scrape type 2
2026-03-27 12:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a035ded3-6a3d-5870-8819-bb065735b37f, identifier: MW16655
2026-03-27 12:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with identifier: JP85458
2026-03-27 12:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with identifier: JP85458
2026-03-27 12:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04d257f6-26ff-5513-98e9-fd73fa5df5a2 with identifier: JP85458 to the API
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:01:33Z',
 'fuel_type': 'petrol',
 'id': '04d257f6-26ff-5513-98e9-fd73fa5df5a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP85458',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 134977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-11',
 'seller_name': None,
 'title': 'Fiat 500 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP85458%27 HTTP/1.1" 200 None
2026-03-27 12:02:50 [auto1.nl] INFO: Saving data for JP85458: {'auction_closing_time': 1774627293.0, 'created_time': 1774378885.651479, 'last_price_update_time': 1774612970.979317}
2026-03-27 12:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP85458') HTTP/1.1" 204 0
2026-03-27 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-27 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655
2026-03-27 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a035ded3-6a3d-5870-8819-bb065735b37f with identifier: MW16655 to the API
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:03:20Z',
 'fuel_type': 'petrol',
 'id': 'a035ded3-6a3d-5870-8819-bb065735b37f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW16655',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 55843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-17',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-27 12:02:51 [auto1.nl] INFO: Saving data for MW16655: {'auction_closing_time': 1774627400.0, 'created_time': 1774526487.240626, 'last_price_update_time': 1774612971.333264}
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW16655') HTTP/1.1" 204 0
2026-03-27 12:02:51 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-27 12:02:51 [auto1.nl] INFO: Scrape type for DU11939: 2
2026-03-27 12:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-27 12:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-27 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891d58cf-ee3b-5e74-90bd-b087b7f63344 with scrape type 2
2026-03-27 12:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 891d58cf-ee3b-5e74-90bd-b087b7f63344, identifier: DU11939
2026-03-27 12:02:51 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-27 12:02:51 [auto1.nl] INFO: Scrape type for FD60498: 2
2026-03-27 12:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-27 12:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-27 12:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-27 12:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e, identifier: FD60498
2026-03-27 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-27 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939
2026-03-27 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 891d58cf-ee3b-5e74-90bd-b087b7f63344 with identifier: DU11939 to the API
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:32:51Z',
 'fuel_type': 'petrol',
 'id': '891d58cf-ee3b-5e74-90bd-b087b7f63344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU11939',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 149308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-20',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2008}
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-27 12:02:51 [auto1.nl] INFO: Saving data for DU11939: {'auction_closing_time': 1774629171.0, 'created_time': 1774378883.943602, 'last_price_update_time': 1774612971.84548}
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU11939') HTTP/1.1" 204 0
2026-03-27 12:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-27 12:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-27 12:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498 to the API
2026-03-27 12:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:05:18Z',
 'fuel_type': 'petrol',
 'id': '90db204c-5894-5d7f-a3b0-b7b9efb29e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD60498',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 160960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-27 12:02:52 [auto1.nl] INFO: Saving data for FD60498: {'auction_closing_time': 1774627518.0, 'created_time': 1773132796.498101, 'last_price_update_time': 1774612972.653865}
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD60498') HTTP/1.1" 204 0
2026-03-27 12:02:52 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 12:02:52 [auto1.nl] INFO: Found listing with ID: MA80468
2026-03-27 12:02:52 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-27 12:02:52 [auto1.nl] INFO: Scrape type for TP38124: 2
2026-03-27 12:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-27 12:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-27 12:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with scrape type 2
2026-03-27 12:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7, identifier: TP38124
2026-03-27 12:02:52 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-27 12:02:52 [auto1.nl] INFO: Scrape type for WZ30415: 2
2026-03-27 12:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-27 12:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-27 12:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with scrape type 2
2026-03-27 12:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4, identifier: WZ30415
2026-03-27 12:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-27 12:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124
2026-03-27 12:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9700523c-b88a-5e0e-a0b2-d5b74785d7d7 with identifier: TP38124 to the API
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:42:41Z',
 'fuel_type': 'petrol',
 'id': '9700523c-b88a-5e0e-a0b2-d5b74785d7d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP38124',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 180879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2014}
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-27 12:02:53 [auto1.nl] INFO: Saving data for TP38124: {'auction_closing_time': 1774629761.0, 'created_time': 1774526507.553276, 'last_price_update_time': 1774612973.24021}
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP38124') HTTP/1.1" 204 0
2026-03-27 12:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-27 12:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415
2026-03-27 12:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d4e06d9-37dc-525f-8727-d33fe0b0eba4 with identifier: WZ30415 to the API
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:33:24Z',
 'fuel_type': 'petrol',
 'id': '3d4e06d9-37dc-525f-8727-d33fe0b0eba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ30415',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 295070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-31',
 'seller_name': None,
 'title': 'Opel Zafira 2.0 Turbo OPC',
 'transmission': 'manual',
 'trim': 'OPC',
 'year': 2003}
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-27 12:02:53 [auto1.nl] INFO: Saving data for WZ30415: {'auction_closing_time': 1774629204.0, 'created_time': 1774526487.712862, 'last_price_update_time': 1774612973.555657}
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ30415') HTTP/1.1" 204 0
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: BW07392
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-27 12:02:53 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: YU72254
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-27 12:02:53 [auto1.nl] INFO: Scrape type for LF56220: 2
2026-03-27 12:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-27 12:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-27 12:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e027e053-3396-563b-b3e2-a882989d6bc4 with scrape type 2
2026-03-27 12:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e027e053-3396-563b-b3e2-a882989d6bc4, identifier: LF56220
2026-03-27 12:02:53 [auto1.nl] INFO: Found listing with ID: BC86626
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC86626%27 HTTP/1.1" 200 None
2026-03-27 12:02:53 [auto1.nl] INFO: Scrape type for BC86626: 2
2026-03-27 12:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d70936f1-eeb7-58ee-904b-fda391005dbc with identifier: BC86626
2026-03-27 12:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d70936f1-eeb7-58ee-904b-fda391005dbc with scrape type 2
2026-03-27 12:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d70936f1-eeb7-58ee-904b-fda391005dbc with scrape type 2
2026-03-27 12:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d70936f1-eeb7-58ee-904b-fda391005dbc, identifier: BC86626
2026-03-27 12:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-27 12:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220
2026-03-27 12:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e027e053-3396-563b-b3e2-a882989d6bc4 with identifier: LF56220 to the API
2026-03-27 12:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-27T16:25:56Z',
 'fuel_type': 'hybrid',
 'id': 'e027e053-3396-563b-b3e2-a882989d6bc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF56220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 218059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-27 12:02:54 [auto1.nl] INFO: Saving data for LF56220: {'auction_closing_time': 1774628756.0, 'created_time': 1774526504.617716, 'last_price_update_time': 1774612974.114849}
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF56220') HTTP/1.1" 204 0
2026-03-27 12:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d70936f1-eeb7-58ee-904b-fda391005dbc with identifier: BC86626
2026-03-27 12:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d70936f1-eeb7-58ee-904b-fda391005dbc with identifier: BC86626
2026-03-27 12:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d70936f1-eeb7-58ee-904b-fda391005dbc with identifier: BC86626 to the API
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:33:16Z',
 'fuel_type': 'petrol',
 'id': 'd70936f1-eeb7-58ee-904b-fda391005dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC86626',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 107568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC86626%27 HTTP/1.1" 200 None
2026-03-27 12:02:54 [auto1.nl] INFO: Saving data for BC86626: {'auction_closing_time': 1774629196.0, 'created_time': 1774526480.487388, 'last_price_update_time': 1774612974.67915}
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BC86626') HTTP/1.1" 204 0
2026-03-27 12:02:54 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-27 12:02:54 [auto1.nl] INFO: Scrape type for KB15106: 2
2026-03-27 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-27 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb94721-a5f8-5b18-b229-1c2144692a0d with scrape type 2
2026-03-27 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adb94721-a5f8-5b18-b229-1c2144692a0d with scrape type 2
2026-03-27 12:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: adb94721-a5f8-5b18-b229-1c2144692a0d, identifier: KB15106
2026-03-27 12:02:54 [auto1.nl] INFO: Found listing with ID: LW83380
2026-03-27 12:02:54 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-27 12:02:54 [auto1.nl] INFO: Scrape type for EB25456: 2
2026-03-27 12:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-27 12:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-27 12:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa005e43-9bf0-537a-9aa4-5b8163c55914 with scrape type 2
2026-03-27 12:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa005e43-9bf0-537a-9aa4-5b8163c55914, identifier: EB25456
2026-03-27 12:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-27 12:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106
2026-03-27 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: adb94721-a5f8-5b18-b229-1c2144692a0d with identifier: KB15106 to the API
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:53:31Z',
 'fuel_type': 'petrol',
 'id': 'adb94721-a5f8-5b18-b229-1c2144692a0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB15106',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 171780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 PureTech Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2017}
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-27 12:02:55 [auto1.nl] INFO: Saving data for KB15106: {'auction_closing_time': 1774630411.0, 'created_time': 1773131904.125128, 'last_price_update_time': 1774612975.225079}
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB15106') HTTP/1.1" 204 0
2026-03-27 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-27 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456
2026-03-27 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa005e43-9bf0-537a-9aa4-5b8163c55914 with identifier: EB25456 to the API
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-27T16:55:18Z',
 'fuel_type': 'hybrid',
 'id': 'fa005e43-9bf0-537a-9aa4-5b8163c55914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB25456',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 178503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-27 12:02:55 [auto1.nl] INFO: Saving data for EB25456: {'auction_closing_time': 1774630518.0, 'created_time': 1774526446.091097, 'last_price_update_time': 1774612975.505015}
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB25456') HTTP/1.1" 204 0
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: CM00025
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00025%27 HTTP/1.1" 200 None
2026-03-27 12:02:55 [auto1.nl] INFO: Scrape type for CM00025: 0
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: JY38775
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: JY48975
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-27 12:02:55 [auto1.nl] INFO: Scrape type for FC33520: 2
2026-03-27 12:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-27 12:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-27 12:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2a6450-f659-5f76-bd5f-f8182c999bcc with scrape type 2
2026-03-27 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f2a6450-f659-5f76-bd5f-f8182c999bcc, identifier: FC33520
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: YH86497
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: DR80364
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-27 12:02:55 [auto1.nl] INFO: Found listing with ID: UJ30832
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ30832%27 HTTP/1.1" 200 None
2026-03-27 12:02:55 [auto1.nl] INFO: Scrape type for UJ30832: 2
2026-03-27 12:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with identifier: UJ30832
2026-03-27 12:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with scrape type 2
2026-03-27 12:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with scrape type 2
2026-03-27 12:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7470edf8-405e-572d-8e43-cf7fd0dc7ce9, identifier: UJ30832
2026-03-27 12:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-27 12:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520
2026-03-27 12:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f2a6450-f659-5f76-bd5f-f8182c999bcc with identifier: FC33520 to the API
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:26:36Z',
 'fuel_type': 'petrol',
 'id': '7f2a6450-f659-5f76-bd5f-f8182c999bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC33520',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 220347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-27 12:02:56 [auto1.nl] INFO: Saving data for FC33520: {'auction_closing_time': 1774628796.0, 'created_time': 1774526496.69668, 'last_price_update_time': 1774612976.04074}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC33520') HTTP/1.1" 204 0
2026-03-27 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with identifier: UJ30832
2026-03-27 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with identifier: UJ30832
2026-03-27 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7470edf8-405e-572d-8e43-cf7fd0dc7ce9 with identifier: UJ30832 to the API
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:18:43Z',
 'fuel_type': 'petrol',
 'id': '7470edf8-405e-572d-8e43-cf7fd0dc7ce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ30832',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 101785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2012}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ30832%27 HTTP/1.1" 200 None
2026-03-27 12:02:56 [auto1.nl] INFO: Saving data for UJ30832: {'auction_closing_time': 1774628323.0, 'created_time': 1774526479.231524, 'last_price_update_time': 1774612976.458099}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ30832') HTTP/1.1" 204 0
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-27 12:02:56 [auto1.nl] INFO: Scrape type for HT85176: 2
2026-03-27 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-27 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-27 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with scrape type 2
2026-03-27 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e8f5641-8913-59fc-a07d-53b1cce8ef56, identifier: HT85176
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-27 12:02:56 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-27 12:02:56 [auto1.nl] INFO: Scrape type for KK56723: 2
2026-03-27 12:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-27 12:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-27 12:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with scrape type 2
2026-03-27 12:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6af16e-6a59-5bee-bde9-300e33c2eab8, identifier: KK56723
2026-03-27 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-27 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176
2026-03-27 12:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e8f5641-8913-59fc-a07d-53b1cce8ef56 with identifier: HT85176 to the API
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:07:45Z',
 'fuel_type': 'diesel',
 'id': '0e8f5641-8913-59fc-a07d-53b1cce8ef56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT85176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 212515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-17',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2008}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-27 12:02:56 [auto1.nl] INFO: Saving data for HT85176: {'auction_closing_time': 1774627665.0, 'created_time': 1774526497.839594, 'last_price_update_time': 1774612976.974927}
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT85176') HTTP/1.1" 204 0
2026-03-27 12:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-27 12:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723
2026-03-27 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6af16e-6a59-5bee-bde9-300e33c2eab8 with identifier: KK56723 to the API
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:22:52Z',
 'fuel_type': 'hybrid',
 'id': '2e6af16e-6a59-5bee-bde9-300e33c2eab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK56723',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 154829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-19',
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-27 12:02:57 [auto1.nl] INFO: Saving data for KK56723: {'auction_closing_time': 1774628572.0, 'created_time': 1774526479.770742, 'last_price_update_time': 1774612977.277666}
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK56723') HTTP/1.1" 204 0
2026-03-27 12:02:57 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-27 12:02:57 [auto1.nl] INFO: Scrape type for GD46513: 2
2026-03-27 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-27 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9023859c-7804-5c43-a201-505fe60481d7 with scrape type 2
2026-03-27 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9023859c-7804-5c43-a201-505fe60481d7 with scrape type 2
2026-03-27 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9023859c-7804-5c43-a201-505fe60481d7, identifier: GD46513
2026-03-27 12:02:57 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-27 12:02:57 [auto1.nl] INFO: Found listing with ID: BB44396
2026-03-27 12:02:57 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-27 12:02:57 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-27 12:02:57 [auto1.nl] INFO: Scrape type for RC67109: 2
2026-03-27 12:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-27 12:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-27 12:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-27 12:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02046a39-e875-5c34-a465-c0d2f2d80f26, identifier: RC67109
2026-03-27 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-27 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513
2026-03-27 12:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9023859c-7804-5c43-a201-505fe60481d7 with identifier: GD46513 to the API
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-27T16:18:14Z',
 'fuel_type': 'diesel',
 'id': '9023859c-7804-5c43-a201-505fe60481d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD46513',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 273288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-21',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-27 12:02:57 [auto1.nl] INFO: Saving data for GD46513: {'auction_closing_time': 1774628294.0, 'created_time': 1773134377.88392, 'last_price_update_time': 1774612977.833776}
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD46513') HTTP/1.1" 204 0
2026-03-27 12:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-27 12:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-27 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109 to the API
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-27T16:27:20Z',
 'fuel_type': 'diesel',
 'id': '02046a39-e875-5c34-a465-c0d2f2d80f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC67109',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 182468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-06',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2012}
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-27 12:02:58 [auto1.nl] INFO: Saving data for RC67109: {'auction_closing_time': 1774628840.0, 'created_time': 1773232228.801859, 'last_price_update_time': 1774612978.236782}
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC67109') HTTP/1.1" 204 0
2026-03-27 12:02:58 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-27 12:02:58 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-27 12:02:58 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-27 12:02:58 [auto1.nl] INFO: Scrape type for LA08041: 2
2026-03-27 12:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-27 12:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 409cdecd-8e73-5819-8f28-343ab470082c with scrape type 2
2026-03-27 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 409cdecd-8e73-5819-8f28-343ab470082c with scrape type 2
2026-03-27 12:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 409cdecd-8e73-5819-8f28-343ab470082c, identifier: LA08041
2026-03-27 12:02:58 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-27 12:02:58 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-27 12:02:58 [auto1.nl] INFO: Scrape type for FR87941: 2
2026-03-27 12:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-27 12:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-27 12:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with scrape type 2
2026-03-27 12:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3, identifier: FR87941
2026-03-27 12:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-27 12:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041
2026-03-27 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 409cdecd-8e73-5819-8f28-343ab470082c with identifier: LA08041 to the API
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:10:57Z',
 'fuel_type': 'petrol',
 'id': '409cdecd-8e73-5819-8f28-343ab470082c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA08041',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 167133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-27 12:02:58 [auto1.nl] INFO: Saving data for LA08041: {'auction_closing_time': 1774627857.0, 'created_time': 1773132933.011571, 'last_price_update_time': 1774612978.777088}
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA08041') HTTP/1.1" 204 0
2026-03-27 12:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-27 12:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941
2026-03-27 12:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3 with identifier: FR87941 to the API
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:28:54Z',
 'fuel_type': 'petrol',
 'id': '69ba76af-1f75-54e6-8b5f-c1ad96e9b9a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR87941',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 117577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Saving data for FR87941: {'auction_closing_time': 1774628934.0, 'created_time': 1774526508.124505, 'last_price_update_time': 1774612979.0613}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR87941') HTTP/1.1" 204 0
2026-03-27 12:02:59 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Scrape type for VA79192: 2
2026-03-27 12:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-27 12:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-27 12:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with scrape type 2
2026-03-27 12:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1, identifier: VA79192
2026-03-27 12:02:59 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1060 | hits on page: 40
2026-03-27 12:02:59 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Scrape type for DF82688: 2
2026-03-27 12:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-27 12:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-27 12:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-27 12:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3, identifier: DF82688
2026-03-27 12:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-27 12:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192
2026-03-27 12:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 95553b68-c4db-5f63-a7c4-4af85e2cc2c1 with identifier: VA79192 to the API
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:07:20Z',
 'fuel_type': 'petrol',
 'id': '95553b68-c4db-5f63-a7c4-4af85e2cc2c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA79192',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2014}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Saving data for VA79192: {'auction_closing_time': 1774627640.0, 'created_time': 1774526494.338331, 'last_price_update_time': 1774612979.581101}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA79192') HTTP/1.1" 204 0
2026-03-27 12:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-27 12:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-27 12:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688 to the API
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:22:23Z',
 'fuel_type': 'petrol',
 'id': '4d9c2f77-39b7-50fc-bc99-611b6d28b7a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF82688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 51601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Saving data for DF82688: {'auction_closing_time': 1774628543.0, 'created_time': 1773133345.831724, 'last_price_update_time': 1774612979.940044}
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF82688') HTTP/1.1" 204 0
2026-03-27 12:02:59 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-27 12:02:59 [auto1.nl] INFO: Scrape type for EA94129: 2
2026-03-27 12:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-27 12:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def9022e-932b-5d82-9b30-edf025877cfa with scrape type 2
2026-03-27 12:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item def9022e-932b-5d82-9b30-edf025877cfa with scrape type 2
2026-03-27 12:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: def9022e-932b-5d82-9b30-edf025877cfa, identifier: EA94129
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-27 12:03:00 [auto1.nl] INFO: Scrape type for WS89953: 2
2026-03-27 12:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-27 12:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with scrape type 2
2026-03-27 12:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with scrape type 2
2026-03-27 12:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3, identifier: WS89953
2026-03-27 12:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-27 12:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-27 12:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129
2026-03-27 12:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: def9022e-932b-5d82-9b30-edf025877cfa with identifier: EA94129 to the API
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 126,
 'expiration_date': '2026-03-27T16:52:50Z',
 'fuel_type': 'petrol',
 'id': 'def9022e-932b-5d82-9b30-edf025877cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA94129',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 122399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2019}
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-27 12:03:00 [auto1.nl] INFO: Saving data for EA94129: {'auction_closing_time': 1774630370.0, 'created_time': 1773131973.906646, 'last_price_update_time': 1774612980.536789}
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EA94129') HTTP/1.1" 204 0
2026-03-27 12:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-27 12:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953
2026-03-27 12:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 143f3ec2-92d7-5eb5-8e19-fec91185ecf3 with identifier: WS89953 to the API
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:57:28Z',
 'fuel_type': 'petrol',
 'id': '143f3ec2-92d7-5eb5-8e19-fec91185ecf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS89953',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 185133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-27 12:03:00 [auto1.nl] INFO: Saving data for WS89953: {'auction_closing_time': 1774630648.0, 'created_time': 1774094504.99501, 'last_price_update_time': 1774612980.933793}
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS89953') HTTP/1.1" 204 0
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-27 12:03:00 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-27 12:03:00 [auto1.nl] INFO: Scrape type for MP21910: 2
2026-03-27 12:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-27 12:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-27 12:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e503149d-281b-59b6-950e-a3d8945ab770 with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e503149d-281b-59b6-950e-a3d8945ab770, identifier: MP21910
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-27 12:03:01 [auto1.nl] INFO: Scrape type for FH26666: 2
2026-03-27 12:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b05fb0ce-f760-5b6c-9430-8ec678f6a400 with identifier: FH26666
2026-03-27 12:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b05fb0ce-f760-5b6c-9430-8ec678f6a400 with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b05fb0ce-f760-5b6c-9430-8ec678f6a400 with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b05fb0ce-f760-5b6c-9430-8ec678f6a400, identifier: FH26666
2026-03-27 12:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-27 12:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910
2026-03-27 12:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e503149d-281b-59b6-950e-a3d8945ab770 with identifier: MP21910 to the API
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:16:46Z',
 'fuel_type': 'petrol',
 'id': 'e503149d-281b-59b6-950e-a3d8945ab770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP21910',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 134300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2018}
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-27 12:03:01 [auto1.nl] INFO: Saving data for MP21910: {'auction_closing_time': 1774628206.0, 'created_time': 1774526483.338157, 'last_price_update_time': 1774612981.500177}
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP21910') HTTP/1.1" 204 0
2026-03-27 12:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b05fb0ce-f760-5b6c-9430-8ec678f6a400 with identifier: FH26666
2026-03-27 12:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b05fb0ce-f760-5b6c-9430-8ec678f6a400 with identifier: FH26666
2026-03-27 12:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b05fb0ce-f760-5b6c-9430-8ec678f6a400 with identifier: FH26666 to the API
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:49:59Z',
 'fuel_type': 'petrol',
 'id': 'b05fb0ce-f760-5b6c-9430-8ec678f6a400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH26666',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 143325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-01',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-27 12:03:01 [auto1.nl] INFO: Saving data for FH26666: {'auction_closing_time': 1774630199.0, 'created_time': 1774526477.481979, 'last_price_update_time': 1774612981.79522}
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH26666') HTTP/1.1" 204 0
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: AY18274
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-27 12:03:01 [auto1.nl] INFO: Scrape type for XY00413: 2
2026-03-27 12:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-27 12:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359e68c0-027b-5100-87fb-9c53256cd1c3 with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 359e68c0-027b-5100-87fb-9c53256cd1c3, identifier: XY00413
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-27 12:03:01 [auto1.nl] INFO: Found listing with ID: SF92286
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SF92286%27 HTTP/1.1" 200 None
2026-03-27 12:03:01 [auto1.nl] INFO: Scrape type for SF92286: 2
2026-03-27 12:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7374b100-8513-5562-8bef-fe4abff94efd with identifier: SF92286
2026-03-27 12:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7374b100-8513-5562-8bef-fe4abff94efd with scrape type 2
2026-03-27 12:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7374b100-8513-5562-8bef-fe4abff94efd with scrape type 2
2026-03-27 12:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7374b100-8513-5562-8bef-fe4abff94efd, identifier: SF92286
2026-03-27 12:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-27 12:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413
2026-03-27 12:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 359e68c0-027b-5100-87fb-9c53256cd1c3 with identifier: XY00413 to the API
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:34:19Z',
 'fuel_type': 'petrol',
 'id': '359e68c0-027b-5100-87fb-9c53256cd1c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY00413',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 76180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2010}
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-27 12:03:02 [auto1.nl] INFO: Saving data for XY00413: {'auction_closing_time': 1774629259.0, 'created_time': 1774526468.820859, 'last_price_update_time': 1774612982.328413}
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY00413') HTTP/1.1" 204 0
2026-03-27 12:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7374b100-8513-5562-8bef-fe4abff94efd with identifier: SF92286
2026-03-27 12:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7374b100-8513-5562-8bef-fe4abff94efd with identifier: SF92286
2026-03-27 12:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7374b100-8513-5562-8bef-fe4abff94efd with identifier: SF92286 to the API
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-27T16:56:02Z',
 'fuel_type': 'diesel',
 'id': '7374b100-8513-5562-8bef-fe4abff94efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF92286',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 369962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-18',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SF92286%27 HTTP/1.1" 200 None
2026-03-27 12:03:02 [auto1.nl] INFO: Saving data for SF92286: {'auction_closing_time': 1774630562.0, 'created_time': 1774526457.928935, 'last_price_update_time': 1774612982.648649}
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SF92286') HTTP/1.1" 204 0
2026-03-27 12:03:02 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-27 12:03:02 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-27 12:03:02 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-27 12:03:02 [auto1.nl] INFO: Scrape type for JT64166: 2
2026-03-27 12:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-27 12:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-27 12:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82c88a9e-c5b7-5075-867a-5a21665e2328 with scrape type 2
2026-03-27 12:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82c88a9e-c5b7-5075-867a-5a21665e2328, identifier: JT64166
2026-03-27 12:03:02 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-27 12:03:02 [auto1.nl] INFO: Scrape type for EC34005: 2
2026-03-27 12:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e8de97-873f-50e3-bbc3-d9a665a5414a with identifier: EC34005
2026-03-27 12:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8de97-873f-50e3-bbc3-d9a665a5414a with scrape type 2
2026-03-27 12:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e8de97-873f-50e3-bbc3-d9a665a5414a with scrape type 2
2026-03-27 12:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96e8de97-873f-50e3-bbc3-d9a665a5414a, identifier: EC34005
2026-03-27 12:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-27 12:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166
2026-03-27 12:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82c88a9e-c5b7-5075-867a-5a21665e2328 with identifier: JT64166 to the API
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:12:31Z',
 'fuel_type': 'petrol',
 'id': '82c88a9e-c5b7-5075-867a-5a21665e2328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT64166',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 209817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-27 12:03:03 [auto1.nl] INFO: Saving data for JT64166: {'auction_closing_time': 1774627951.0, 'created_time': 1774526484.730215, 'last_price_update_time': 1774612983.189819}
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JT64166') HTTP/1.1" 204 0
2026-03-27 12:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96e8de97-873f-50e3-bbc3-d9a665a5414a with identifier: EC34005
2026-03-27 12:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96e8de97-873f-50e3-bbc3-d9a665a5414a with identifier: EC34005
2026-03-27 12:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96e8de97-873f-50e3-bbc3-d9a665a5414a with identifier: EC34005 to the API
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:18:25Z',
 'fuel_type': 'diesel',
 'id': '96e8de97-873f-50e3-bbc3-d9a665a5414a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC34005',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 291599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2012}
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-27 12:03:03 [auto1.nl] INFO: Saving data for EC34005: {'auction_closing_time': 1774628305.0, 'created_time': 1774526467.872837, 'last_price_update_time': 1774612983.587641}
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EC34005') HTTP/1.1" 204 0
2026-03-27 12:03:03 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-27 12:03:03 [auto1.nl] INFO: Scrape type for KD04773: 2
2026-03-27 12:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-27 12:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-27 12:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with scrape type 2
2026-03-27 12:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8cc2d4fd-7837-5363-a9a9-59e20aecd285, identifier: KD04773
2026-03-27 12:03:03 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-27 12:03:03 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-27 12:03:03 [auto1.nl] INFO: Scrape type for LD78562: 2
2026-03-27 12:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-27 12:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-27 12:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5727513d-93cb-5a28-a9c2-3deb89ee0476 with scrape type 2
2026-03-27 12:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5727513d-93cb-5a28-a9c2-3deb89ee0476, identifier: LD78562
2026-03-27 12:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-27 12:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773
2026-03-27 12:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8cc2d4fd-7837-5363-a9a9-59e20aecd285 with identifier: KD04773 to the API
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:40:38Z',
 'fuel_type': 'petrol',
 'id': '8cc2d4fd-7837-5363-a9a9-59e20aecd285',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD04773',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 56902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Cosmo Pack',
 'transmission': 'manual',
 'trim': 'Cosmo Pack',
 'year': 2016}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-27 12:03:04 [auto1.nl] INFO: Saving data for KD04773: {'auction_closing_time': 1774629638.0, 'created_time': 1774526486.835577, 'last_price_update_time': 1774612984.117687}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD04773') HTTP/1.1" 204 0
2026-03-27 12:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-27 12:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562
2026-03-27 12:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5727513d-93cb-5a28-a9c2-3deb89ee0476 with identifier: LD78562 to the API
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-27T16:33:00Z',
 'fuel_type': 'petrol',
 'id': '5727513d-93cb-5a28-a9c2-3deb89ee0476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD78562',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 295518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-27 12:03:04 [auto1.nl] INFO: Saving data for LD78562: {'auction_closing_time': 1774629180.0, 'created_time': 1774001973.259294, 'last_price_update_time': 1774612984.4048}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD78562') HTTP/1.1" 204 0
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-27 12:03:04 [auto1.nl] INFO: Scrape type for DX40194: 2
2026-03-27 12:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with identifier: DX40194
2026-03-27 12:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with scrape type 2
2026-03-27 12:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with scrape type 2
2026-03-27 12:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f48a8885-1ea6-51a2-8ba4-20ffa5895a0e, identifier: DX40194
2026-03-27 12:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with identifier: DX40194
2026-03-27 12:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with identifier: DX40194
2026-03-27 12:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f48a8885-1ea6-51a2-8ba4-20ffa5895a0e with identifier: DX40194 to the API
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-27T16:00:09Z',
 'fuel_type': 'petrol',
 'id': 'f48a8885-1ea6-51a2-8ba4-20ffa5895a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX40194',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 115727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI CityScape BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'CityScape BlueMotion Tech',
 'year': 2014}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-27 12:03:04 [auto1.nl] INFO: Saving data for DX40194: {'auction_closing_time': 1774627209.0, 'created_time': 1774526468.275454, 'last_price_update_time': 1774612984.790459}
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX40194') HTTP/1.1" 204 0
2026-03-27 12:03:04 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-27 12:03:04 [auto1.nl] INFO: Scrape type for WC55998: 2
2026-03-27 12:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-27 12:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-27 12:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with scrape type 2
2026-03-27 12:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b, identifier: WC55998
2026-03-27 12:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-27 12:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998
2026-03-27 12:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b with identifier: WC55998 to the API
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-27T16:05:31Z',
 'fuel_type': 'petrol',
 'id': '9f6e8c4f-3ff2-5152-8bbf-06ef202d3b4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC55998',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 257159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-10',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-27 12:03:05 [auto1.nl] INFO: Saving data for WC55998: {'auction_closing_time': 1774627531.0, 'created_time': 1774526460.881914, 'last_price_update_time': 1774612985.291821}
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC55998') HTTP/1.1" 204 0
2026-03-27 12:03:05 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-27 12:03:05 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-27 12:03:05 [auto1.nl] INFO: Scrape type for JH98357: 2
2026-03-27 12:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-27 12:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-27 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-27 12:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b6929fd4-fbb5-5def-b36d-64f97912ad14, identifier: JH98357
2026-03-27 12:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-27 12:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-27 12:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357 to the API
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-27T16:11:57Z',
 'fuel_type': 'petrol',
 'id': 'b6929fd4-fbb5-5def-b36d-64f97912ad14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH98357',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 159756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-27 12:03:05 [auto1.nl] INFO: Saving data for JH98357: {'auction_closing_time': 1774627917.0, 'created_time': 1774526471.468998, 'last_price_update_time': 1774612985.739243}
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH98357') HTTP/1.1" 204 0
2026-03-27 12:03:05 [auto1.nl] INFO: Found listing with ID: SY88026
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY88026%27 HTTP/1.1" 200 None
2026-03-27 12:03:05 [auto1.nl] INFO: Scrape type for SY88026: 2
2026-03-27 12:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b0efbf5-a099-5815-9d65-7482eca92d12 with identifier: SY88026
2026-03-27 12:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b0efbf5-a099-5815-9d65-7482eca92d12 with scrape type 2
2026-03-27 12:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b0efbf5-a099-5815-9d65-7482eca92d12 with scrape type 2
2026-03-27 12:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3b0efbf5-a099-5815-9d65-7482eca92d12, identifier: SY88026
2026-03-27 12:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3b0efbf5-a099-5815-9d65-7482eca92d12 with identifier: SY88026
2026-03-27 12:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3b0efbf5-a099-5815-9d65-7482eca92d12 with identifier: SY88026
2026-03-27 12:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3b0efbf5-a099-5815-9d65-7482eca92d12 with identifier: SY88026 to the API
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:54:06Z',
 'fuel_type': 'diesel',
 'id': '3b0efbf5-a099-5815-9d65-7482eca92d12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY88026',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 310022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-20',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY88026%27 HTTP/1.1" 200 None
2026-03-27 12:03:06 [auto1.nl] INFO: Saving data for SY88026: {'auction_closing_time': 1774630446.0, 'created_time': 1774008055.307865, 'last_price_update_time': 1774612986.262522}
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY88026') HTTP/1.1" 204 0
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-27 12:03:06 [auto1.nl] INFO: Scrape type for WK39469: 2
2026-03-27 12:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f843e8-dab2-5958-9583-57082197d4b7 with identifier: WK39469
2026-03-27 12:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f843e8-dab2-5958-9583-57082197d4b7 with scrape type 2
2026-03-27 12:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f843e8-dab2-5958-9583-57082197d4b7 with scrape type 2
2026-03-27 12:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9f843e8-dab2-5958-9583-57082197d4b7, identifier: WK39469
2026-03-27 12:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9f843e8-dab2-5958-9583-57082197d4b7 with identifier: WK39469
2026-03-27 12:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9f843e8-dab2-5958-9583-57082197d4b7 with identifier: WK39469
2026-03-27 12:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9f843e8-dab2-5958-9583-57082197d4b7 with identifier: WK39469 to the API
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-27T16:01:41Z',
 'fuel_type': 'petrol',
 'id': 'f9f843e8-dab2-5958-9583-57082197d4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK39469',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 95717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-10',
 'seller_name': None,
 'title': 'Renault Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2016}
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-27 12:03:06 [auto1.nl] INFO: Saving data for WK39469: {'auction_closing_time': 1774627301.0, 'created_time': 1774526462.458431, 'last_price_update_time': 1774612986.698649}
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK39469') HTTP/1.1" 204 0
2026-03-27 12:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-27 12:03:06 [auto1.nl] INFO: Scrape type for XY38299: 0
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-27 12:03:06 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-27 12:03:06 [auto1.nl] INFO: Scrape type for JK19053: 2
2026-03-27 12:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8db7dc3-7907-5937-b6a9-853f95597f3d with identifier: JK19053
2026-03-27 12:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8db7dc3-7907-5937-b6a9-853f95597f3d with scrape type 2
2026-03-27 12:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8db7dc3-7907-5937-b6a9-853f95597f3d with scrape type 2
2026-03-27 12:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b8db7dc3-7907-5937-b6a9-853f95597f3d, identifier: JK19053
2026-03-27 12:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b8db7dc3-7907-5937-b6a9-853f95597f3d with identifier: JK19053
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:03:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 12:03:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b8db7dc3-7907-5937-b6a9-853f95597f3d with identifier: JK19053
2026-03-27 12:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b8db7dc3-7907-5937-b6a9-853f95597f3d with identifier: JK19053 to the API
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-27T16:40:45Z',
 'fuel_type': 'hybrid',
 'id': 'b8db7dc3-7907-5937-b6a9-853f95597f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK19053',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 221307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Exclusive',
 'transmission': 'automatic',
 'trim': 'T Exclusive',
 'year': 2015}
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-27 12:03:07 [auto1.nl] INFO: Saving data for JK19053: {'auction_closing_time': 1774629645.0, 'created_time': 1774526466.063344, 'last_price_update_time': 1774612987.304539}
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK19053') HTTP/1.1" 204 0
2026-03-27 12:03:07 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-27 12:03:07 [auto1.nl] INFO: Scrape type for MJ47722: 2
2026-03-27 12:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-27 12:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-27 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08dc3162-687d-561c-8a0f-a64e30ae2351 with scrape type 2
2026-03-27 12:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08dc3162-687d-561c-8a0f-a64e30ae2351, identifier: MJ47722
2026-03-27 12:03:07 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 20 pages/min), scraped 152 items (at 60 items/min)
2026-03-27 12:03:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-27 12:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-27 12:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722
2026-03-27 12:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08dc3162-687d-561c-8a0f-a64e30ae2351 with identifier: MJ47722 to the API
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:40:07Z',
 'fuel_type': 'petrol',
 'id': '08dc3162-687d-561c-8a0f-a64e30ae2351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ47722',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-08',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-27 12:03:07 [auto1.nl] INFO: Saving data for MJ47722: {'auction_closing_time': 1774629607.0, 'created_time': 1774526463.278356, 'last_price_update_time': 1774612987.731832}
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MJ47722') HTTP/1.1" 204 0
2026-03-27 12:03:07 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1060 | hits on page: 20
2026-03-27 12:03:07 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-27 12:03:07 [auto1.nl] INFO: Scrape type for RT82599: 2
2026-03-27 12:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-27 12:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with scrape type 2
2026-03-27 12:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with scrape type 2
2026-03-27 12:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2, identifier: RT82599
2026-03-27 12:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-27 12:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599
2026-03-27 12:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2 with identifier: RT82599 to the API
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:23:24Z',
 'fuel_type': 'petrol',
 'id': '0ee536a9-ef4e-5ed8-95d1-aad10a72dfa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT82599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 42320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-27 12:03:08 [auto1.nl] INFO: Saving data for RT82599: {'auction_closing_time': 1774628604.0, 'created_time': 1773132696.649105, 'last_price_update_time': 1774612988.220077}
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT82599') HTTP/1.1" 204 0
2026-03-27 12:03:08 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-27 12:03:08 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-27 12:03:08 [auto1.nl] INFO: Scrape type for RX96199: 2
2026-03-27 12:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-27 12:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d7b49b0-90d6-5da7-825f-10b72008c875 with scrape type 2
2026-03-27 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d7b49b0-90d6-5da7-825f-10b72008c875 with scrape type 2
2026-03-27 12:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d7b49b0-90d6-5da7-825f-10b72008c875, identifier: RX96199
2026-03-27 12:03:08 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-27 12:03:08 [auto1.nl] INFO: Scrape type for RY51498: 2
2026-03-27 12:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-27 12:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-27 12:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01169767-6f64-578c-bae4-993e41c16c16 with scrape type 2
2026-03-27 12:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01169767-6f64-578c-bae4-993e41c16c16, identifier: RY51498
2026-03-27 12:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-27 12:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199
2026-03-27 12:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d7b49b0-90d6-5da7-825f-10b72008c875 with identifier: RX96199 to the API
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:29:57Z',
 'fuel_type': 'petrol',
 'id': '9d7b49b0-90d6-5da7-825f-10b72008c875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX96199',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 108441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Fiat Punto 0.9 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-27 12:03:08 [auto1.nl] INFO: Saving data for RX96199: {'auction_closing_time': 1774628997.0, 'created_time': 1774526460.016744, 'last_price_update_time': 1774612988.95406}
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RX96199') HTTP/1.1" 204 0
2026-03-27 12:03:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-27 12:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498
2026-03-27 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01169767-6f64-578c-bae4-993e41c16c16 with identifier: RY51498 to the API
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:55:21Z',
 'fuel_type': 'petrol',
 'id': '01169767-6f64-578c-bae4-993e41c16c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY51498',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 264209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 FSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2004}
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-27 12:03:09 [auto1.nl] INFO: Saving data for RY51498: {'auction_closing_time': 1774630521.0, 'created_time': 1774033466.589215, 'last_price_update_time': 1774612989.257106}
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY51498') HTTP/1.1" 204 0
2026-03-27 12:03:09 [auto1.nl] INFO: Found listing with ID: TN49193
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN49193%27 HTTP/1.1" 200 None
2026-03-27 12:03:09 [auto1.nl] INFO: Scrape type for TN49193: 2
2026-03-27 12:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99fb4cad-bc30-5323-a9ab-81c523503ea1 with identifier: TN49193
2026-03-27 12:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99fb4cad-bc30-5323-a9ab-81c523503ea1 with scrape type 2
2026-03-27 12:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99fb4cad-bc30-5323-a9ab-81c523503ea1 with scrape type 2
2026-03-27 12:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99fb4cad-bc30-5323-a9ab-81c523503ea1, identifier: TN49193
2026-03-27 12:03:09 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-27 12:03:09 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-27 12:03:09 [auto1.nl] INFO: Scrape type for PL46145: 2
2026-03-27 12:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-27 12:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 944f64e1-301c-5d53-b780-b56c5c98a6f6 with scrape type 2
2026-03-27 12:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 944f64e1-301c-5d53-b780-b56c5c98a6f6 with scrape type 2
2026-03-27 12:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 944f64e1-301c-5d53-b780-b56c5c98a6f6, identifier: PL46145
2026-03-27 12:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99fb4cad-bc30-5323-a9ab-81c523503ea1 with identifier: TN49193
2026-03-27 12:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99fb4cad-bc30-5323-a9ab-81c523503ea1 with identifier: TN49193
2026-03-27 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99fb4cad-bc30-5323-a9ab-81c523503ea1 with identifier: TN49193 to the API
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-27T16:53:07Z',
 'fuel_type': 'hybrid',
 'id': '99fb4cad-bc30-5323-a9ab-81c523503ea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN49193',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 53973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2021}
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN49193%27 HTTP/1.1" 200 None
2026-03-27 12:03:09 [auto1.nl] INFO: Saving data for TN49193: {'auction_closing_time': 1774630387.0, 'created_time': 1774526464.342067, 'last_price_update_time': 1774612989.845934}
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN49193') HTTP/1.1" 204 0
2026-03-27 12:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-27 12:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145
2026-03-27 12:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 944f64e1-301c-5d53-b780-b56c5c98a6f6 with identifier: PL46145 to the API
2026-03-27 12:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:17:36Z',
 'fuel_type': 'petrol',
 'id': '944f64e1-301c-5d53-b780-b56c5c98a6f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL46145',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 215118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-06',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2014}
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-27 12:03:10 [auto1.nl] INFO: Saving data for PL46145: {'auction_closing_time': 1774628256.0, 'created_time': 1774526464.728842, 'last_price_update_time': 1774612990.128428}
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PL46145') HTTP/1.1" 204 0
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-27 12:03:10 [auto1.nl] INFO: Scrape type for WR79727: 2
2026-03-27 12:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d06c85-b0bf-5789-8fff-640be4b27b81 with identifier: WR79727
2026-03-27 12:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d06c85-b0bf-5789-8fff-640be4b27b81 with scrape type 2
2026-03-27 12:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8d06c85-b0bf-5789-8fff-640be4b27b81 with scrape type 2
2026-03-27 12:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8d06c85-b0bf-5789-8fff-640be4b27b81, identifier: WR79727
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: EK15803
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: HS95558
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-27 12:03:10 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-27 12:03:10 [auto1.nl] INFO: Scrape type for JA24721: 2
2026-03-27 12:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with identifier: JA24721
2026-03-27 12:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with scrape type 2
2026-03-27 12:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with scrape type 2
2026-03-27 12:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28, identifier: JA24721
2026-03-27 12:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8d06c85-b0bf-5789-8fff-640be4b27b81 with identifier: WR79727
2026-03-27 12:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8d06c85-b0bf-5789-8fff-640be4b27b81 with identifier: WR79727
2026-03-27 12:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8d06c85-b0bf-5789-8fff-640be4b27b81 with identifier: WR79727 to the API
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:47:20Z',
 'fuel_type': 'petrol',
 'id': 'c8d06c85-b0bf-5789-8fff-640be4b27b81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR79727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 91969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-27 12:03:10 [auto1.nl] INFO: Saving data for WR79727: {'auction_closing_time': 1774630040.0, 'created_time': 1774526472.780061, 'last_price_update_time': 1774612990.658311}
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WR79727') HTTP/1.1" 204 0
2026-03-27 12:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with identifier: JA24721
2026-03-27 12:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with identifier: JA24721
2026-03-27 12:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28 with identifier: JA24721 to the API
2026-03-27 12:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:17:17Z',
 'fuel_type': 'petrol',
 'id': 'fc23eb7e-e8b0-5fb1-abd5-e0141e72ed28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA24721',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 192972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2019}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-27 12:03:11 [auto1.nl] INFO: Saving data for JA24721: {'auction_closing_time': 1774628237.0, 'created_time': 1774526462.905306, 'last_price_update_time': 1774612991.161415}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JA24721') HTTP/1.1" 204 0
2026-03-27 12:03:11 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-27 12:03:11 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-27 12:03:11 [auto1.nl] INFO: Found listing with ID: KJ96677
2026-03-27 12:03:11 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-27 12:03:11 [auto1.nl] INFO: Scrape type for AX29422: 2
2026-03-27 12:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0003dd-627c-57d9-92a6-aaf4215707b6 with identifier: AX29422
2026-03-27 12:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f0003dd-627c-57d9-92a6-aaf4215707b6 with scrape type 2
2026-03-27 12:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f0003dd-627c-57d9-92a6-aaf4215707b6 with scrape type 2
2026-03-27 12:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6f0003dd-627c-57d9-92a6-aaf4215707b6, identifier: AX29422
2026-03-27 12:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6f0003dd-627c-57d9-92a6-aaf4215707b6 with identifier: AX29422
2026-03-27 12:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6f0003dd-627c-57d9-92a6-aaf4215707b6 with identifier: AX29422
2026-03-27 12:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6f0003dd-627c-57d9-92a6-aaf4215707b6 with identifier: AX29422 to the API
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:12:41Z',
 'fuel_type': 'diesel',
 'id': '6f0003dd-627c-57d9-92a6-aaf4215707b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX29422',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 423390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-20',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2008}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-27 12:03:11 [auto1.nl] INFO: Saving data for AX29422: {'auction_closing_time': 1774627961.0, 'created_time': 1773134121.657846, 'last_price_update_time': 1774612991.573011}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX29422') HTTP/1.1" 204 0
2026-03-27 12:03:11 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-27 12:03:11 [auto1.nl] INFO: Scrape type for DF87411: 2
2026-03-27 12:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-27 12:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-27 12:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a460bdb-cac6-5457-88e8-45d0702eab76 with scrape type 2
2026-03-27 12:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a460bdb-cac6-5457-88e8-45d0702eab76, identifier: DF87411
2026-03-27 12:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-27 12:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411
2026-03-27 12:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a460bdb-cac6-5457-88e8-45d0702eab76 with identifier: DF87411 to the API
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:23:07Z',
 'fuel_type': 'petrol',
 'id': '4a460bdb-cac6-5457-88e8-45d0702eab76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF87411',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 130172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-27 12:03:11 [auto1.nl] INFO: Saving data for DF87411: {'auction_closing_time': 1774628587.0, 'created_time': 1774526474.990101, 'last_price_update_time': 1774612991.984188}
2026-03-27 12:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF87411') HTTP/1.1" 204 0
2026-03-27 12:03:12 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-27 12:03:12 [auto1.nl] INFO: Scrape type for UA44354: 2
2026-03-27 12:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-27 12:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-27 12:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6bf74ae-ea26-5e34-8fe8-484868109907 with scrape type 2
2026-03-27 12:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6bf74ae-ea26-5e34-8fe8-484868109907, identifier: UA44354
2026-03-27 12:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-27 12:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354
2026-03-27 12:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6bf74ae-ea26-5e34-8fe8-484868109907 with identifier: UA44354 to the API
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-27T16:29:29Z',
 'fuel_type': 'petrol',
 'id': 'd6bf74ae-ea26-5e34-8fe8-484868109907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA44354',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 164078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-27 12:03:12 [auto1.nl] INFO: Saving data for UA44354: {'auction_closing_time': 1774628969.0, 'created_time': 1774526475.493805, 'last_price_update_time': 1774612992.612244}
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA44354') HTTP/1.1" 204 0
2026-03-27 12:03:12 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-27 12:03:12 [auto1.nl] INFO: Scrape type for JJ61661: 2
2026-03-27 12:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93762a0-3035-5b93-8461-784419a77092 with identifier: JJ61661
2026-03-27 12:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93762a0-3035-5b93-8461-784419a77092 with scrape type 2
2026-03-27 12:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f93762a0-3035-5b93-8461-784419a77092 with scrape type 2
2026-03-27 12:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f93762a0-3035-5b93-8461-784419a77092, identifier: JJ61661
2026-03-27 12:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f93762a0-3035-5b93-8461-784419a77092 with identifier: JJ61661
2026-03-27 12:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f93762a0-3035-5b93-8461-784419a77092 with identifier: JJ61661
2026-03-27 12:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f93762a0-3035-5b93-8461-784419a77092 with identifier: JJ61661 to the API
2026-03-27 12:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-27T16:52:22Z',
 'fuel_type': 'hybrid',
 'id': 'f93762a0-3035-5b93-8461-784419a77092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ61661',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 83848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-30',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-27 12:03:13 [auto1.nl] INFO: Saving data for JJ61661: {'auction_closing_time': 1774630342.0, 'created_time': 1773134687.355614, 'last_price_update_time': 1774612993.403566}
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ61661') HTTP/1.1" 204 0
2026-03-27 12:03:13 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-27 12:03:13 [auto1.nl] INFO: Scrape type for KP98004: 2
2026-03-27 12:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-27 12:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-27 12:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32785756-aa7c-5091-908d-c11fe7e13fe3 with scrape type 2
2026-03-27 12:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32785756-aa7c-5091-908d-c11fe7e13fe3, identifier: KP98004
2026-03-27 12:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-27 12:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004
2026-03-27 12:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32785756-aa7c-5091-908d-c11fe7e13fe3 with identifier: KP98004 to the API
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-27T16:34:33Z',
 'fuel_type': 'hybrid',
 'id': '32785756-aa7c-5091-908d-c11fe7e13fe3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP98004',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 72861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-27 12:03:13 [auto1.nl] INFO: Saving data for KP98004: {'auction_closing_time': 1774629273.0, 'created_time': 1774526471.831529, 'last_price_update_time': 1774612993.833279}
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP98004') HTTP/1.1" 204 0
2026-03-27 12:03:13 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-27 12:03:13 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-27 12:03:13 [auto1.nl] INFO: Scrape type for PZ30163: 2
2026-03-27 12:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-27 12:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-27 12:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with scrape type 2
2026-03-27 12:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2, identifier: PZ30163
2026-03-27 12:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-27 12:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163
2026-03-27 12:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2 with identifier: PZ30163 to the API
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:09:06Z',
 'fuel_type': 'petrol',
 'id': '162ec0e3-24e0-5e3d-a3e6-76b2bf0e54c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ30163',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 168552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-26',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-27 12:03:14 [auto1.nl] INFO: Saving data for PZ30163: {'auction_closing_time': 1774627746.0, 'created_time': 1774526476.553527, 'last_price_update_time': 1774612994.288278}
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ30163') HTTP/1.1" 204 0
2026-03-27 12:03:14 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-27 12:03:14 [auto1.nl] INFO: Scrape type for RL18676: 2
2026-03-27 12:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-27 12:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-27 12:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-27 12:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7888771b-1c1d-55e9-beb7-2c5bad3225a3, identifier: RL18676
2026-03-27 12:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-27 12:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-27 12:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676 to the API
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-27T16:41:23Z',
 'fuel_type': 'petrol',
 'id': '7888771b-1c1d-55e9-beb7-2c5bad3225a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL18676',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-27 12:03:14 [auto1.nl] INFO: Saving data for RL18676: {'auction_closing_time': 1774629683.0, 'created_time': 1773132401.211667, 'last_price_update_time': 1774612994.707497}
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL18676') HTTP/1.1" 204 0
2026-03-27 12:03:14 [auto1.nl] INFO: Channel: 24h | Page: 28 | totalHits: 1060 | hits on page: 0
2026-03-27 12:03:14 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-27 12:03:14 [auto1.nl] INFO: Scrape type for RF14080: 2
2026-03-27 12:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-27 12:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-27 12:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f58db08d-2df7-51eb-b014-a8599e085b07 with scrape type 2
2026-03-27 12:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f58db08d-2df7-51eb-b014-a8599e085b07, identifier: RF14080
2026-03-27 12:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-27 12:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080
2026-03-27 12:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f58db08d-2df7-51eb-b014-a8599e085b07 with identifier: RF14080 to the API
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:47:37Z',
 'fuel_type': 'petrol',
 'id': 'f58db08d-2df7-51eb-b014-a8599e085b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF14080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 427233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Volvo V50 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-27 12:03:15 [auto1.nl] INFO: Saving data for RF14080: {'auction_closing_time': 1774630057.0, 'created_time': 1774526469.927141, 'last_price_update_time': 1774612995.324186}
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF14080') HTTP/1.1" 204 0
2026-03-27 12:03:15 [auto1.nl] INFO: Found listing with ID: WN67246
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN67246%27 HTTP/1.1" 200 None
2026-03-27 12:03:15 [auto1.nl] INFO: Scrape type for WN67246: 2
2026-03-27 12:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 328aae50-c1b8-5d26-a716-948e92b7c5fa with identifier: WN67246
2026-03-27 12:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 328aae50-c1b8-5d26-a716-948e92b7c5fa with scrape type 2
2026-03-27 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 328aae50-c1b8-5d26-a716-948e92b7c5fa with scrape type 2
2026-03-27 12:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 328aae50-c1b8-5d26-a716-948e92b7c5fa, identifier: WN67246
2026-03-27 12:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 328aae50-c1b8-5d26-a716-948e92b7c5fa with identifier: WN67246
2026-03-27 12:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 328aae50-c1b8-5d26-a716-948e92b7c5fa with identifier: WN67246
2026-03-27 12:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 328aae50-c1b8-5d26-a716-948e92b7c5fa with identifier: WN67246 to the API
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-27T16:31:30Z',
 'fuel_type': 'petrol',
 'id': '328aae50-c1b8-5d26-a716-948e92b7c5fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN67246',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 138055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-04',
 'seller_name': None,
 'title': 'Peugeot 208 1.0 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN67246%27 HTTP/1.1" 200 None
2026-03-27 12:03:15 [auto1.nl] INFO: Saving data for WN67246: {'auction_closing_time': 1774629090.0, 'created_time': 1774526470.271356, 'last_price_update_time': 1774612995.730291}
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN67246') HTTP/1.1" 204 0
2026-03-27 12:03:15 [auto1.nl] INFO: Found listing with ID: TY96036
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY96036%27 HTTP/1.1" 200 None
2026-03-27 12:03:15 [auto1.nl] INFO: Scrape type for TY96036: 2
2026-03-27 12:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3502adbc-d902-5e1d-9652-b337829c04c2 with identifier: TY96036
2026-03-27 12:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3502adbc-d902-5e1d-9652-b337829c04c2 with scrape type 2
2026-03-27 12:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3502adbc-d902-5e1d-9652-b337829c04c2 with scrape type 2
2026-03-27 12:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3502adbc-d902-5e1d-9652-b337829c04c2, identifier: TY96036
2026-03-27 12:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3502adbc-d902-5e1d-9652-b337829c04c2 with identifier: TY96036
2026-03-27 12:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3502adbc-d902-5e1d-9652-b337829c04c2 with identifier: TY96036
2026-03-27 12:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3502adbc-d902-5e1d-9652-b337829c04c2 with identifier: TY96036 to the API
2026-03-27 12:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:23:20Z',
 'fuel_type': 'petrol',
 'id': '3502adbc-d902-5e1d-9652-b337829c04c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY96036',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 82752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-01',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY96036%27 HTTP/1.1" 200 None
2026-03-27 12:03:16 [auto1.nl] INFO: Saving data for TY96036: {'auction_closing_time': 1774628600.0, 'created_time': 1773133184.681804, 'last_price_update_time': 1774612996.143633}
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY96036') HTTP/1.1" 204 0
2026-03-27 12:03:16 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-27 12:03:16 [auto1.nl] INFO: Scrape type for MY95801: 2
2026-03-27 12:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-27 12:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-27 12:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with scrape type 2
2026-03-27 12:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd, identifier: MY95801
2026-03-27 12:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-27 12:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801
2026-03-27 12:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd with identifier: MY95801 to the API
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-27T16:49:57Z',
 'fuel_type': 'petrol',
 'id': 'fdf7c4a4-d51c-5b5d-91c1-a0a2dba73acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY95801',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 85105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'BMW 5er 520i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-27 12:03:16 [auto1.nl] INFO: Saving data for MY95801: {'auction_closing_time': 1774630197.0, 'created_time': 1774526473.15677, 'last_price_update_time': 1774612996.554526}
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY95801') HTTP/1.1" 204 0
2026-03-27 12:03:16 [auto1.nl] INFO: Found listing with ID: KX43550
2026-03-27 12:03:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 12:03:16 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-27 12:03:16 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-27 12:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774180996 HTTP/1.1" 200 None
2026-03-27 12:03:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (171 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-27T12_00_00.jl
2026-03-27 12:03:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 629626,
 'downloader/request_count': 357,
 'downloader/request_method_count/GET': 327,
 'downloader/request_method_count/POST': 30,
 'downloader/response_bytes': 75569697,
 'downloader/response_count': 357,
 'downloader/response_status_count/200': 357,
 'dupefilter/filtered': 17,
 'elapsed_time_seconds': 189.792251,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 12, 3, 17, 115782, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 171,
 'log_count/DEBUG': 4535,
 'log_count/INFO': 4909,
 'memusage/max': 198246400,
 'memusage/startup': 150294528,
 'photo_download_count': 229,
 'request_depth_max': 31,
 'response_received_count': 128,
 'scheduler/dequeued': 357,
 'scheduler/dequeued/memory': 357,
 'scheduler/enqueued': 357,
 'scheduler/enqueued/memory': 357,
 'scrape_type/batch_skipped': 549,
 'scrape_type/new': 48,
 'scrape_type/price_update': 123,
 'scrape_type/skipped': 363,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 128,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.718335150515489,
 'scrapy-zyte-api/mean_response_seconds': 5.7403345585626075,
 'scrapy-zyte-api/processed': 128,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 128,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 127,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 128,
 'scrapy-zyte-api/request_args/httpRequestBody': 30,
 'scrapy-zyte-api/request_args/httpRequestMethod': 30,
 'scrapy-zyte-api/request_args/httpResponseBody': 128,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 128,
 'scrapy-zyte-api/request_args/sessionContext': 128,
 'scrapy-zyte-api/request_args/url': 128,
 'scrapy-zyte-api/status_codes/200': 128,
 'scrapy-zyte-api/success': 128,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1100,
 'source/total_available': 1060,
 'start_time': datetime.datetime(2026, 3, 27, 12, 0, 7, 323531, tzinfo=datetime.timezone.utc)}
2026-03-27 12:03:17 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 12:03:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc3c4b8a250>
2026-03-27 12:03:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fc3c4cd8110>