2026-03-28 12:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 12:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 12:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-28 12:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 12:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 12:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 12:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 12:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 12:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 65dfe184ff888073
2026-03-28 12:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 12:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-28T12_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 12:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 12:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 12:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-28 12:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 12:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 12:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 12:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 12:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 12:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 12:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 12:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-28 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 12:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 12:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 12:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 12:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 12:10:15 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.nl] INFO: Scrape type for UE65811: 1
2026-03-28 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.nl] INFO: Scrape type for UY86442: 1
2026-03-28 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.nl] INFO: Scrape type for WG90560: 1
2026-03-28 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 12:10:15 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-28 12:10:15 [auto1.nl] INFO: Scrape type for UR39080: 2
2026-03-28 12:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-28 12:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-28 12:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df17881-0615-5640-83e9-cd5295bb909e with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1df17881-0615-5640-83e9-cd5295bb909e, identifier: UR39080
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080
2026-03-28 12:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1df17881-0615-5640-83e9-cd5295bb909e with identifier: UR39080 to the API
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:20Z',
 'fuel_type': 'petrol',
 'id': '1df17881-0615-5640-83e9-cd5295bb909e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR39080',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 135996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2019}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Saving data for UR39080: {'auction_closing_time': 1774885940.0, 'created_time': 1774440681.940592, 'last_price_update_time': 1774699816.666988}
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR39080') HTTP/1.1" 204 0
2026-03-28 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for PH88105: 1
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for UF12505: 1
2026-03-28 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for XK28167: 1
2026-03-28 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for JC30911: 1
2026-03-28 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for AX92237: 1
2026-03-28 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 12:10:16 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-28 12:10:16 [auto1.nl] INFO: Scrape type for UB73502: 2
2026-03-28 12:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-28 12:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64f9130-0f9b-5b88-bb20-60061a5dd155 with scrape type 2
2026-03-28 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e64f9130-0f9b-5b88-bb20-60061a5dd155, identifier: UB73502
2026-03-28 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-28 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502
2026-03-28 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e64f9130-0f9b-5b88-bb20-60061a5dd155 with identifier: UB73502 to the API
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:10:54Z',
 'fuel_type': 'hybrid',
 'id': 'e64f9130-0f9b-5b88-bb20-60061a5dd155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB73502',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 52410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.nl] INFO: Saving data for UB73502: {'auction_closing_time': 1774883454.0, 'created_time': 1774465873.211142, 'last_price_update_time': 1774699817.337315}
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UB73502') HTTP/1.1" 204 0
2026-03-28 12:10:17 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.nl] INFO: Scrape type for TP02076: 1
2026-03-28 12:10:17 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 12:10:17 [auto1.nl] INFO: Found listing with ID: UV97115
2026-03-28 12:10:17 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-28 12:10:17 [auto1.nl] INFO: Scrape type for BV07887: 2
2026-03-28 12:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-28 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33db28ef-ee4f-5660-808f-2816e530db27 with scrape type 2
2026-03-28 12:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33db28ef-ee4f-5660-808f-2816e530db27, identifier: BV07887
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887
2026-03-28 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33db28ef-ee4f-5660-808f-2816e530db27 with identifier: BV07887 to the API
2026-03-28 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:15:19Z',
 'fuel_type': 'diesel',
 'id': '33db28ef-ee4f-5660-808f-2816e530db27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV07887',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 282108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 HDi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2012}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Saving data for BV07887: {'auction_closing_time': 1774883719.0, 'created_time': 1774033986.549565, 'last_price_update_time': 1774699818.165045}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV07887') HTTP/1.1" 204 0
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Scrape type for ZE09391: 1
2026-03-28 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY86442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Scrape type for ER86910: 1
2026-03-28 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Scrape type for DR23359: 2
2026-03-28 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-28 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc639650-0ba1-56f0-a8f7-8b35e619087c with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc639650-0ba1-56f0-a8f7-8b35e619087c, identifier: DR23359
2026-03-28 12:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-28 12:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359
2026-03-28 12:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc639650-0ba1-56f0-a8f7-8b35e619087c with identifier: DR23359 to the API
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': 'dc639650-0ba1-56f0-a8f7-8b35e619087c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR23359',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 179090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-02',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2012}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Saving data for DR23359: {'auction_closing_time': 1774884913.0, 'created_time': 1774034001.769749, 'last_price_update_time': 1774699818.68172}
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR23359') HTTP/1.1" 204 0
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 12:10:18 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-28 12:10:18 [auto1.nl] INFO: Scrape type for MH16372: 2
2026-03-28 12:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-28 12:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with scrape type 2
2026-03-28 12:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210, identifier: MH16372
2026-03-28 12:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-28 12:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372
2026-03-28 12:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20dadf3f-b2a1-5a7d-ad79-3960c0c71210 with identifier: MH16372 to the API
2026-03-28 12:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '20dadf3f-b2a1-5a7d-ad79-3960c0c71210',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH16372',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 271085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Saving data for MH16372: {'auction_closing_time': 1774885477.0, 'created_time': 1774552324.378703, 'last_price_update_time': 1774699819.19742}
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MH16372') HTTP/1.1" 204 0
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE65811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for ME24209: 1
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF12505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG90560/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC30911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for PU27111: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for EH33258: 1
2026-03-28 12:10:19 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/UE65811/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK28167/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH88105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for SE67800: 1
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for TN45594: 1
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for UB73502: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: UV97115
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV07887%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for BV07887: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR23359%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for DR23359: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for MH16372: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-28 12:10:19 [auto1.nl] INFO: Scrape type for PU27111: 0
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-28 12:10:19 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-28 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX92237/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH33258/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP02076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for HK48702: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for PX89333: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for JM32164: 1
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE09391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for HM06318: 1
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for KH60865: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for GS42620: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for YJ91466: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for PA65227: 1
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY86442> (referer: https://www.auto1.com/v1/car-details-view/UY86442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for HG71940: 1
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for MV57262: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for VS29188: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for ZZ45478: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for RW57039: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for HM15601: 1
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for GP36316: 1
2026-03-28 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-28 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 1
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg not downloaded yet
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for UE83954: 1
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_fbe18cbc5fab316bfc5004d05db11781.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fbe18cbc5fab316bfc5004d05db11781.jpg not downloaded yet
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for XG85677: 1
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER86910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg not downloaded yet
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [auto1.nl] INFO: Scrape type for SX97177: 1
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg not downloaded yet
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-28 12:10:20 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg not downloaded yet
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg not downloaded yet
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME24209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg not downloaded yet
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg not downloaded yet
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_14595172ff552cfe59a8ccfc55a4679d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_14595172ff552cfe59a8ccfc55a4679d.jpg not downloaded yet
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_5e4d5f9e58461f556c36b6151a97729b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5e4d5f9e58461f556c36b6151a97729b.jpg not downloaded yet
2026-03-28 12:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE67800/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5e4d5f9e58461f556c36b6151a97729b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fbe18cbc5fab316bfc5004d05db11781.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC30911> (referer: https://www.auto1.com/v1/car-details-view/JC30911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0e5c90>
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_5e4d5f9e58461f556c36b6151a97729b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5e4d5f9e58461f556c36b6151a97729b.jpg saved to cache
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE65811> (referer: https://www.auto1.com/v1/car-details-view/UE65811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f5a790>
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_fbe18cbc5fab316bfc5004d05db11781.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fbe18cbc5fab316bfc5004d05db11781.jpg saved to cache
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-28 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 1
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg not downloaded yet
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg not downloaded yet
2026-03-28 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG90560> (referer: https://www.auto1.com/v1/car-details-view/WG90560/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913beb2010>
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg saved to cache
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-28 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850fcbff-7ba8-5c99-853f-846716cf8cf1 with scrape type 1
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 850fcbff-7ba8-5c99-853f-846716cf8cf1
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_9f9139695b40a4635301253ff3fa0a30.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9f9139695b40a4635301253ff3fa0a30.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_571ce831aae6aa334a8c9b9d2d6b08ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_571ce831aae6aa334a8c9b9d2d6b08ab.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_d6fa80fb89a987b11dc5294f70dcf2bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_d6fa80fb89a987b11dc5294f70dcf2bb.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_2fbb4a0aba7f50e6a4e258e2f0336e0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_2fbb4a0aba7f50e6a4e258e2f0336e0d.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_0b6a7635dc34bd51b075b0d981bb27f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0b6a7635dc34bd51b075b0d981bb27f8.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_9c7a0ca9900e0f160134ff9bb5e878b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9c7a0ca9900e0f160134ff9bb5e878b1.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_33c6b21bee47b5bb0abffec594a345d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_33c6b21bee47b5bb0abffec594a345d8.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_0175578bac5ba4c90e746c5cf2f93e4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0175578bac5ba4c90e746c5cf2f93e4d.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_dd6898dac6ff0b297938fc684f6cafe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_dd6898dac6ff0b297938fc684f6cafe3.jpg already downloaded
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F7d%252F0b7d396f7400ddca13e19b4bf0b1d3b2%252Fpa%252FUE65811_1729081bb2f23c4e7f8b33e118207c64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_1729081bb2f23c4e7f8b33e118207c64.jpg already downloaded
2026-03-28 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 850fcbff-7ba8-5c99-853f-846716cf8cf1, identifier: UE65811
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg not downloaded yet
2026-03-28 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-28 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811
2026-03-28 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 850fcbff-7ba8-5c99-853f-846716cf8cf1 with identifier: UE65811 to the API
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UE65811>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:31Z',
 'fuel_type': 'petrol',
 'id': '850fcbff-7ba8-5c99-853f-846716cf8cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XH177T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE65811',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 85958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9f9139695b40a4635301253ff3fa0a30.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_571ce831aae6aa334a8c9b9d2d6b08ab.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_d6fa80fb89a987b11dc5294f70dcf2bb.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_2fbb4a0aba7f50e6a4e258e2f0336e0d.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0b6a7635dc34bd51b075b0d981bb27f8.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9c7a0ca9900e0f160134ff9bb5e878b1.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_33c6b21bee47b5bb0abffec594a345d8.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0175578bac5ba4c90e746c5cf2f93e4d.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_dd6898dac6ff0b297938fc684f6cafe3.jpg',
                'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_1729081bb2f23c4e7f8b33e118207c64.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9f9139695b40a4635301253ff3fa0a30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2655624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_571ce831aae6aa334a8c9b9d2d6b08ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2524235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_d6fa80fb89a987b11dc5294f70dcf2bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_2fbb4a0aba7f50e6a4e258e2f0336e0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512035,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0b6a7635dc34bd51b075b0d981bb27f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_9c7a0ca9900e0f160134ff9bb5e878b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_33c6b21bee47b5bb0abffec594a345d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_0175578bac5ba4c90e746c5cf2f93e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_dd6898dac6ff0b297938fc684f6cafe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_850fcbff-7ba8-5c99-853f-846716cf8cf1/850fcbff-7ba8-5c99-853f-846716cf8cf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/7d/0b7d396f7400ddca13e19b4bf0b1d3b2/pa/UE65811_1729081bb2f23c4e7f8b33e118207c64.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE65811%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [auto1.nl] INFO: Saving data for UE65811: {'created_time': 1774699822.279204, 'last_price_update_time': 1774699822.279213, 'auction_closing_time': 1774883131.0}
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE65811') HTTP/1.1" 204 0
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg not downloaded yet
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF12505> (referer: https://www.auto1.com/v1/car-details-view/UF12505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH33258> (referer: https://www.auto1.com/v1/car-details-view/EH33258/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK28167> (referer: https://www.auto1.com/v1/car-details-view/XK28167/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX92237> (referer: https://www.auto1.com/v1/car-details-view/AX92237/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH88105> (referer: https://www.auto1.com/v1/car-details-view/PH88105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_17061ca797909aca5260599080b2b4c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_17061ca797909aca5260599080b2b4c0.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_c951cdc0eef8322afd5999b873684b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_c951cdc0eef8322afd5999b873684b55.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_cb965752344fa3dbba779987773b33d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_cb965752344fa3dbba779987773b33d6.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_331e6d8976e4a1287804b9ce87269c62.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_331e6d8976e4a1287804b9ce87269c62.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_2439c9cb756cded612e6029fa30a2035.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_2439c9cb756cded612e6029fa30a2035.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_5c73f32076f9105bb0542ff6de735474.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5c73f32076f9105bb0542ff6de735474.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_4627eab9c6518795ebcb0cda595ae238.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4627eab9c6518795ebcb0cda595ae238.jpg not downloaded yet
2026-03-28 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-28 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 1
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_708a8c527d52979fcc44657a48cdaefe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_708a8c527d52979fcc44657a48cdaefe.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_8162437efa056254cbce2a3480a1f6d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_8162437efa056254cbce2a3480a1f6d5.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_4b40288788d26d6f424a74ddd338ade7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_4b40288788d26d6f424a74ddd338ade7.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg not downloaded yet
2026-03-28 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_63971793d1282083a8a4ca12ddc46c99.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_63971793d1282083a8a4ca12ddc46c99.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_4f70902ee836c1582effc0ba3f0b596f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_4f70902ee836c1582effc0ba3f0b596f.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_3d177dc277aeba73c4635fb8b3567d19.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_3d177dc277aeba73c4635fb8b3567d19.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_6bcb02a24077d818211c7bd7b000d67c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_6bcb02a24077d818211c7bd7b000d67c.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_e273a441263c2620465de4c9caf9167c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_e273a441263c2620465de4c9caf9167c.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_13dec59a79a377db5f6454e038c16a01.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_13dec59a79a377db5f6454e038c16a01.jpg not downloaded yet
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_9ceee9565a0c8f916eb8affd9423103f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_9ceee9565a0c8f916eb8affd9423103f.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_bfd279ead31865475e53e11dec6e5385.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_bfd279ead31865475e53e11dec6e5385.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_9b233af536c5471e19a3e71f99691e2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9b233af536c5471e19a3e71f99691e2c.jpg not downloaded yet
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951bf50>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_cc75010b6af96b0449ef18bddb25a861.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_cc75010b6af96b0449ef18bddb25a861.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_57d916536c844fd41f9c726064f8aa53.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d916536c844fd41f9c726064f8aa53.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_4a0ea8a126d398007d0ed954627326f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4a0ea8a126d398007d0ed954627326f0.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP02076> (referer: https://www.auto1.com/v1/car-details-view/TP02076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_5780f7a165502679235b02ad45a412d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5780f7a165502679235b02ad45a412d1.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_a79166089904d4f20f40950d40bde01a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_a79166089904d4f20f40950d40bde01a.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_2db87c4e99a053ac50d936fec7779222.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_2db87c4e99a053ac50d936fec7779222.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_9cb26f988a05606650f1f50ab0dfac27.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cb26f988a05606650f1f50ab0dfac27.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d916536c844fd41f9c726064f8aa53.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_7a738543688100263f02bcc5db9a7461.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7a738543688100263f02bcc5db9a7461.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_c519442d067bcff974750e4a7794211c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_c519442d067bcff974750e4a7794211c.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4a0ea8a126d398007d0ed954627326f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-28 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 1
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_7338433d5af8ca821b67576171d3840f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_7338433d5af8ca821b67576171d3840f.jpg not downloaded yet
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913956dd10>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a10c110>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139411410>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139410ed0>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951d790>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_d961e1416773829e2cc3d5a69a30308c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_d961e1416773829e2cc3d5a69a30308c.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_cc75010b6af96b0449ef18bddb25a861.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_63b7ba4f33938911d4f741f28656d20f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_63b7ba4f33938911d4f741f28656d20f.jpg not downloaded yet
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg not downloaded yet
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913955d390>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139542110>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_57d916536c844fd41f9c726064f8aa53.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d916536c844fd41f9c726064f8aa53.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393ecf10>
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_4a0ea8a126d398007d0ed954627326f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4a0ea8a126d398007d0ed954627326f0.jpg saved to cache
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg not downloaded yet
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM32164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA65227/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cb26f988a05606650f1f50ab0dfac27.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg not downloaded yet
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913955d390>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_cc75010b6af96b0449ef18bddb25a861.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_cc75010b6af96b0449ef18bddb25a861.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139427690>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_14595172ff552cfe59a8ccfc55a4679d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE67800> (referer: https://www.auto1.com/v1/car-details-view/SE67800/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg not downloaded yet
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME24209> (referer: https://www.auto1.com/v1/car-details-view/ME24209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER86910> (referer: https://www.auto1.com/v1/car-details-view/ER86910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b83d0>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394ca350>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_9cb26f988a05606650f1f50ab0dfac27.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cb26f988a05606650f1f50ab0dfac27.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f27a50>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_14595172ff552cfe59a8ccfc55a4679d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_14595172ff552cfe59a8ccfc55a4679d.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-28 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 1
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_2260faa85105917c94be00d59e399158.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_2260faa85105917c94be00d59e399158.jpg not downloaded yet
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg not downloaded yet
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-28 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 1
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg not downloaded yet
2026-03-28 12:10:24 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-28 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 1
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg not downloaded yet
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a195a50>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a07c750>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ede290>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_4b89f5d5904db28780e033203e5b642b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_4b89f5d5904db28780e033203e5b642b.jpg not downloaded yet
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_18063db927cfe4ffa4cb282bbadff121.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_18063db927cfe4ffa4cb282bbadff121.jpg not downloaded yet
2026-03-28 12:10:24 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.nl] INFO: Scrape type for PF57895: 1
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_3221544202279b16f6da1a8bd8a96836.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_3221544202279b16f6da1a8bd8a96836.jpg not downloaded yet
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg not downloaded yet
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg not downloaded yet
2026-03-28 12:10:24 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.nl] INFO: Scrape type for HV92208: 1
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_f16597fcb3bf366e65bac612891b5723.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_f16597fcb3bf366e65bac612891b5723.jpg not downloaded yet
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_f89d5bf5d675400493a522c5f7b85c76.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_f89d5bf5d675400493a522c5f7b85c76.jpg not downloaded yet
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139603b90>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f02590>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg saved to cache
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_d961e1416773829e2cc3d5a69a30308c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg not downloaded yet
2026-03-28 12:10:24 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [auto1.nl] INFO: Scrape type for WY33906: 1
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg not downloaded yet
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_7338433d5af8ca821b67576171d3840f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913956b650>
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_9ac379537c247c7f743d096d173f26a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_9ac379537c247c7f743d096d173f26a6.jpg not downloaded yet
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for WN49119: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg not downloaded yet
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for XM87869: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg not downloaded yet
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f24910>
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_d961e1416773829e2cc3d5a69a30308c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_d961e1416773829e2cc3d5a69a30308c.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_2260faa85105917c94be00d59e399158.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for FB82909: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_a8baa8f0548ef9077bd21de726f04e98.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_a8baa8f0548ef9077bd21de726f04e98.jpg not downloaded yet
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139418390>
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_7338433d5af8ca821b67576171d3840f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_7338433d5af8ca821b67576171d3840f.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395748d0>
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for YX65431: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_26956ac74eb217297ac4154435e249f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_26956ac74eb217297ac4154435e249f4.jpg not downloaded yet
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139579510>
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_2260faa85105917c94be00d59e399158.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_2260faa85105917c94be00d59e399158.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for MZ74119: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_88669fda7ed8e8841c806f17171d410b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_88669fda7ed8e8841c806f17171d410b.jpg not downloaded yet
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for GW58352: 1
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_e134813f2bbb2df07599b924d779f421.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_e134813f2bbb2df07599b924d779f421.jpg not downloaded yet
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-28 12:10:25 [auto1.nl] INFO: Scrape type for JB09830: 2
2026-03-28 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-28 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with scrape type 2
2026-03-28 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1edba11a-c0b2-5440-bb87-ac751f84ffa8, identifier: JB09830
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f01f90>
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg saved to cache
2026-03-28 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_f89d5bf5d675400493a522c5f7b85c76.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830
2026-03-28 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1edba11a-c0b2-5440-bb87-ac751f84ffa8 with identifier: JB09830 to the API
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:16:01Z',
 'fuel_type': 'electro',
 'id': '1edba11a-c0b2-5440-bb87-ac751f84ffa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB09830',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 156843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-22',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2021}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB09830%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.nl] INFO: Saving data for JB09830: {'auction_closing_time': 1774883761.0, 'created_time': 1773904222.46797, 'last_price_update_time': 1774699826.28497}
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB09830') HTTP/1.1" 204 0
2026-03-28 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_c519442d067bcff974750e4a7794211c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:26 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-28 12:10:26 [auto1.nl] INFO: Scrape type for CY78777: 1
2026-03-28 12:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395c96d0>
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg saved to cache
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913957e150>
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252Ffb%252F60fb28cb372ee61ab060cc9e032f0167%252Fpa%252FTP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg saved to cache
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5243dc9-af76-596e-895a-5a4b86723b1a
2026-03-28 12:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5243dc9-af76-596e-895a-5a4b86723b1a, skipping ID generation
2026-03-28 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5243dc9-af76-596e-895a-5a4b86723b1a with scrape type 1
2026-03-28 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5243dc9-af76-596e-895a-5a4b86723b1a sending to next pipeline
2026-03-28 12:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5243dc9-af76-596e-895a-5a4b86723b1a, identifier: TP02076
2026-03-28 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_f16597fcb3bf366e65bac612891b5723.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM32164> (referer: https://www.auto1.com/v1/car-details-view/JM32164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV92208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA65227> (referer: https://www.auto1.com/v1/car-details-view/PA65227/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-28 12:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076
2026-03-28 12:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5243dc9-af76-596e-895a-5a4b86723b1a with identifier: TP02076 to the API
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:19Z',
 'fuel_type': 'diesel',
 'id': 'e5243dc9-af76-596e-895a-5a4b86723b1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SN197K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP02076',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 279912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_7338433d5af8ca821b67576171d3840f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_bc8a8f639d35baa6939b7acf08f074c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_d281ed4f36c1d51f40a773cfbd14762f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_1e622e0aef3446edd031a0f5fd9cbd55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5243dc9-af76-596e-895a-5a4b86723b1a/e5243dc9-af76-596e-895a-5a4b86723b1a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/fb/60fb28cb372ee61ab060cc9e032f0167/pa/TP02076_6303bbebfbf7bc50ff454260c4e25a16.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 1.8 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP02076%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.nl] INFO: Saving data for TP02076: {'created_time': 1774699827.069048, 'last_price_update_time': 1774699827.06906, 'auction_closing_time': 1774886359.0}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP02076') HTTP/1.1" 204 0
2026-03-28 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:27 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-28 12:10:27 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-28 12:10:27 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.nl] INFO: Scrape type for DL13637: 1
2026-03-28 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_e134813f2bbb2df07599b924d779f421.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b2890>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg saved to cache
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395cb110>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_f89d5bf5d675400493a522c5f7b85c76.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_f89d5bf5d675400493a522c5f7b85c76.jpg saved to cache
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393a77d0>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_c519442d067bcff974750e4a7794211c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_c519442d067bcff974750e4a7794211c.jpg saved to cache
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:27 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.nl] INFO: Scrape type for CD19489: 2
2026-03-28 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-28 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with scrape type 2
2026-03-28 12:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a, identifier: CD19489
2026-03-28 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-28 12:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489
2026-03-28 12:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b98dca43-a229-54a0-a3f5-ed30d4ca8d4a with identifier: CD19489 to the API
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'hybrid',
 'id': 'b98dca43-a229-54a0-a3f5-ed30d4ca8d4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD19489',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 140826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-02',
 'seller_name': None,
 'title': 'Volvo V60 2.4 D6 Plug-in Hybrid Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2014}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD19489%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.nl] INFO: Saving data for CD19489: {'auction_closing_time': 1774884721.0, 'created_time': 1773429050.698539, 'last_price_update_time': 1774699827.716504}
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD19489') HTTP/1.1" 204 0
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913967fb90>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_f16597fcb3bf366e65bac612891b5723.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_f16597fcb3bf366e65bac612891b5723.jpg saved to cache
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-28 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 1
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_b49fc48578b3aaf99c373be2591e24b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_b49fc48578b3aaf99c373be2591e24b5.jpg not downloaded yet
2026-03-28 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-28 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 1
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_621c2791132ba11d2c0fafd807e3c229.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_621c2791132ba11d2c0fafd807e3c229.jpg not downloaded yet
2026-03-28 12:10:27 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-28 12:10:27 [auto1.nl] INFO: Scrape type for RY80321: 1
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139522150>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg saved to cache
2026-03-28 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913954af10>
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg saved to cache
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a11bf10>
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_e134813f2bbb2df07599b924d779f421.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_e134813f2bbb2df07599b924d779f421.jpg saved to cache
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_88669fda7ed8e8841c806f17171d410b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_227fec376d53a01af868b275aafc90f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_227fec376d53a01af868b275aafc90f0.jpg not downloaded yet
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_93d4efd6e45689931724697c61ac217a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_93d4efd6e45689931724697c61ac217a.jpg not downloaded yet
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.nl] INFO: Scrape type for KC04488: 2
2026-03-28 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-28 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af6988aa-27fb-518d-a792-2f321a99c71f with scrape type 2
2026-03-28 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: af6988aa-27fb-518d-a792-2f321a99c71f, identifier: KC04488
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM87869/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913954a010>
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg saved to cache
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_26956ac74eb217297ac4154435e249f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-28 12:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488
2026-03-28 12:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: af6988aa-27fb-518d-a792-2f321a99c71f with identifier: KC04488 to the API
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:35:56Z',
 'fuel_type': 'petrol',
 'id': 'af6988aa-27fb-518d-a792-2f321a99c71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC04488',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 153034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-10',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play',
 'transmission': 'manual',
 'trim': 'X-Play',
 'year': 2016}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC04488%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.nl] INFO: Saving data for KC04488: {'auction_closing_time': 1774884956.0, 'created_time': 1774034001.440451, 'last_price_update_time': 1774699828.667721}
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC04488') HTTP/1.1" 204 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_0eba9397625175a88e9827f9c796a468.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_0eba9397625175a88e9827f9c796a468.jpg not downloaded yet
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_42180fbe313a2347f7cad24114d98bbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_42180fbe313a2347f7cad24114d98bbb.jpg not downloaded yet
2026-03-28 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB82909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.nl] INFO: Scrape type for SK13348: 1
2026-03-28 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_e051ad286fd3f36dcbedb903df96747d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_e051ad286fd3f36dcbedb903df96747d.jpg not downloaded yet
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_fcc339c65add137b262c62c85f8b5162.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_fcc339c65add137b262c62c85f8b5162.jpg not downloaded yet
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394f6d90>
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_88669fda7ed8e8841c806f17171d410b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_88669fda7ed8e8841c806f17171d410b.jpg saved to cache
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.nl] INFO: Scrape type for JB39700: 1
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_621c2791132ba11d2c0fafd807e3c229.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_93d4efd6e45689931724697c61ac217a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_51a8949f36fd444e9b4194c372c0f55c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_51a8949f36fd444e9b4194c372c0f55c.jpg not downloaded yet
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_7125322d4014da42aa952f86b67794c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_7125322d4014da42aa952f86b67794c1.jpg not downloaded yet
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0151d0>
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_26956ac74eb217297ac4154435e249f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_26956ac74eb217297ac4154435e249f4.jpg saved to cache
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [auto1.nl] INFO: Scrape type for NZ86515: 1
2026-03-28 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW58352/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg not downloaded yet
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg not downloaded yet
2026-03-28 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-28 12:10:28 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.nl] INFO: Scrape type for WK03460: 1
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_9fa1dd150916b44a949603e66cebcb7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_9fa1dd150916b44a949603e66cebcb7b.jpg not downloaded yet
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg not downloaded yet
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_63b7ba4f33938911d4f741f28656d20f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.nl] INFO: Scrape type for FG02230: 1
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_fcc339c65add137b262c62c85f8b5162.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_65cc03aa716720273fd6148a97a2c3ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_65cc03aa716720273fd6148a97a2c3ce.jpg not downloaded yet
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_6310e401ed5c9f9d050d0a45f8c61af3.png%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6310e401ed5c9f9d050d0a45f8c61af3.png not downloaded yet
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951ead0>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_621c2791132ba11d2c0fafd807e3c229.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_621c2791132ba11d2c0fafd807e3c229.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b1c50>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_93d4efd6e45689931724697c61ac217a.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_93d4efd6e45689931724697c61ac217a.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:29 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-28 12:10:29 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.nl] INFO: Scrape type for NX59327: 1
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg not downloaded yet
2026-03-28 12:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913bf1f690>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:29 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [auto1.nl] INFO: Scrape type for AB36156: 1
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg not downloaded yet
2026-03-28 12:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a112810>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_63b7ba4f33938911d4f741f28656d20f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_63b7ba4f33938911d4f741f28656d20f.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395cf850>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_fcc339c65add137b262c62c85f8b5162.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_fcc339c65add137b262c62c85f8b5162.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YX65431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ74119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY78777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL13637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_a8baa8f0548ef9077bd21de726f04e98.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_227fec376d53a01af868b275aafc90f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6310e401ed5c9f9d050d0a45f8c61af3.png> (referer: https://www.auto1.com/)
2026-03-28 12:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393be110>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_a8baa8f0548ef9077bd21de726f04e98.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_a8baa8f0548ef9077bd21de726f04e98.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN49119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b7a90>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_227fec376d53a01af868b275aafc90f0.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_227fec376d53a01af868b275aafc90f0.jpg saved to cache
2026-03-28 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1efa50>
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d70d0>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d6990>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-28 12:10:30 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-28 12:10:30 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 62 285
2026-03-28 12:10:30 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 359 8192
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a052090>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_7.png HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_6310e401ed5c9f9d050d0a45f8c61af3.png') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6310e401ed5c9f9d050d0a45f8c61af3.png saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY80321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_65cc03aa716720273fd6148a97a2c3ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951b810>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_65cc03aa716720273fd6148a97a2c3ce.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_65cc03aa716720273fd6148a97a2c3ce.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ86515/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0484d0>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM87869> (referer: https://www.auto1.com/v1/car-details-view/XM87869/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_9fa1dd150916b44a949603e66cebcb7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB36156/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-28 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 1
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_7d764169b987922b54a0059411cd9bf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_7d764169b987922b54a0059411cd9bf6.jpg not downloaded yet
2026-03-28 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_61453fff6a41b58f7bef295f6965e6c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_61453fff6a41b58f7bef295f6965e6c6.jpg not downloaded yet
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg not downloaded yet
2026-03-28 12:10:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a092210>
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_9fa1dd150916b44a949603e66cebcb7b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_9fa1dd150916b44a949603e66cebcb7b.jpg saved to cache
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_179b4e73f786bff84ab721add0b3ca91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_179b4e73f786bff84ab721add0b3ca91.jpg not downloaded yet
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg not downloaded yet
2026-03-28 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_c35916c4a3da625ab299a0ef03e71131.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_c35916c4a3da625ab299a0ef03e71131.jpg not downloaded yet
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393ba2d0>
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg saved to cache
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg not downloaded yet
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg not downloaded yet
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_cd8654b2207f32c126e6d3deebafd616.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_cd8654b2207f32c126e6d3deebafd616.jpg not downloaded yet
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_d29056f77b7463f025e6b0929ad2a688.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d29056f77b7463f025e6b0929ad2a688.jpg not downloaded yet
2026-03-28 12:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_7d764169b987922b54a0059411cd9bf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW58352> (referer: https://www.auto1.com/v1/car-details-view/GW58352/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139688b50>
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_7d764169b987922b54a0059411cd9bf6.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_7d764169b987922b54a0059411cd9bf6.jpg saved to cache
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d29056f77b7463f025e6b0929ad2a688.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_cd8654b2207f32c126e6d3deebafd616.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX59327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-28 12:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with scrape type 1
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8092a7e4-d46c-56b9-adfc-9f19a63dd41c
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_003b6a055571338b0eab3db56fd3ae51.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_003b6a055571338b0eab3db56fd3ae51.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_6715ff3bb3b5cbc841b885d31ab99e40.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_6715ff3bb3b5cbc841b885d31ab99e40.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_41ad0bcd32faf4f766091535ad037dd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_41ad0bcd32faf4f766091535ad037dd2.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_0534f46bee27cd7f7925f46eed56dfe4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_0534f46bee27cd7f7925f46eed56dfe4.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_030b62e64412d19e03e86eb076169303.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_030b62e64412d19e03e86eb076169303.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_12b5f232e1e98d0181340ffed7db94ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_12b5f232e1e98d0181340ffed7db94ed.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_40c0658af6333e11c5d12b29a839c842.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_40c0658af6333e11c5d12b29a839c842.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_e88b94b2cf0ef855f83d99410947fd15.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e88b94b2cf0ef855f83d99410947fd15.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_e623e7cc0a688fbd898b2bc8f11e156b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e623e7cc0a688fbd898b2bc8f11e156b.jpg already downloaded
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fdc%252Feedc5f58dc49c9939cf788c238f1cb0f%252Fpa%252FGW58352_3c1c7ea9b46379f4d7a9b9fb6ea9c5dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_3c1c7ea9b46379f4d7a9b9fb6ea9c5dc.jpg already downloaded
2026-03-28 12:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c, identifier: GW58352
2026-03-28 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-28 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352
2026-03-28 12:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8092a7e4-d46c-56b9-adfc-9f19a63dd41c with identifier: GW58352 to the API
2026-03-28 12:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW58352>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:12Z',
 'fuel_type': 'petrol',
 'id': '8092a7e4-d46c-56b9-adfc-9f19a63dd41c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '9zht33',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW58352',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 106180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_003b6a055571338b0eab3db56fd3ae51.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_6715ff3bb3b5cbc841b885d31ab99e40.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_41ad0bcd32faf4f766091535ad037dd2.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_0534f46bee27cd7f7925f46eed56dfe4.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_030b62e64412d19e03e86eb076169303.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_12b5f232e1e98d0181340ffed7db94ed.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_40c0658af6333e11c5d12b29a839c842.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e88b94b2cf0ef855f83d99410947fd15.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e623e7cc0a688fbd898b2bc8f11e156b.jpg',
                'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_3c1c7ea9b46379f4d7a9b9fb6ea9c5dc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_003b6a055571338b0eab3db56fd3ae51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052868,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_6715ff3bb3b5cbc841b885d31ab99e40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_41ad0bcd32faf4f766091535ad037dd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_0534f46bee27cd7f7925f46eed56dfe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3399941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_030b62e64412d19e03e86eb076169303.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_12b5f232e1e98d0181340ffed7db94ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_40c0658af6333e11c5d12b29a839c842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e88b94b2cf0ef855f83d99410947fd15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3153717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_e623e7cc0a688fbd898b2bc8f11e156b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8092a7e4-d46c-56b9-adfc-9f19a63dd41c/8092a7e4-d46c-56b9-adfc-9f19a63dd41c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/dc/eedc5f58dc49c9939cf788c238f1cb0f/pa/GW58352_3c1c7ea9b46379f4d7a9b9fb6ea9c5dc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW58352%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [auto1.nl] INFO: Saving data for GW58352: {'created_time': 1774699832.219375, 'last_price_update_time': 1774699832.219386, 'auction_closing_time': 1774884372.0}
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW58352') HTTP/1.1" 204 0
2026-03-28 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB39700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY78777> (referer: https://www.auto1.com/v1/car-details-view/CY78777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL13637> (referer: https://www.auto1.com/v1/car-details-view/DL13637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ74119> (referer: https://www.auto1.com/v1/car-details-view/MZ74119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f04dd0>
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_d29056f77b7463f025e6b0929ad2a688.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d29056f77b7463f025e6b0929ad2a688.jpg saved to cache
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f00810>
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_cd8654b2207f32c126e6d3deebafd616.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_cd8654b2207f32c126e6d3deebafd616.jpg saved to cache
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-28 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with scrape type 1
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0e205ab4-26b7-517e-a4bf-5cd859a04f47
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_002a22eea59684905fe2ca02f36c3279.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_002a22eea59684905fe2ca02f36c3279.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_09b16c3f9931db0df42ac7241d3ec4cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_09b16c3f9931db0df42ac7241d3ec4cd.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_59a36cf4e9314522aad9915473d5b3ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_59a36cf4e9314522aad9915473d5b3ea.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_069f7c683d0aa4ce1f6eea60bff88656.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_069f7c683d0aa4ce1f6eea60bff88656.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_0999220a07c9dca90309c139243701b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_0999220a07c9dca90309c139243701b1.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_c643d0f464679495841acad91d7b96c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_c643d0f464679495841acad91d7b96c8.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_43ec1c7e0a9e9501afd50fc6d4d1a166.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_43ec1c7e0a9e9501afd50fc6d4d1a166.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_5d216a48f927f7c89bb8b2a9cbbbe875.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_5d216a48f927f7c89bb8b2a9cbbbe875.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_a19fd0971a49126885896ac504b4cf15.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a19fd0971a49126885896ac504b4cf15.jpg already downloaded
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F1d%252F571d7d4ddd6fd57f347734d0e03c5476%252Fpa%252FCY78777_a06054d3db86a8b3fd5bf7c5b96493d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a06054d3db86a8b3fd5bf7c5b96493d0.jpg already downloaded
2026-03-28 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e205ab4-26b7-517e-a4bf-5cd859a04f47, identifier: CY78777
2026-03-28 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-28 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777
2026-03-28 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e205ab4-26b7-517e-a4bf-5cd859a04f47 with identifier: CY78777 to the API
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY78777>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:44:52Z',
 'fuel_type': 'petrol',
 'id': '0e205ab4-26b7-517e-a4bf-5cd859a04f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HB-785-D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY78777',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 156543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_002a22eea59684905fe2ca02f36c3279.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_09b16c3f9931db0df42ac7241d3ec4cd.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_59a36cf4e9314522aad9915473d5b3ea.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_069f7c683d0aa4ce1f6eea60bff88656.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_0999220a07c9dca90309c139243701b1.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_c643d0f464679495841acad91d7b96c8.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_43ec1c7e0a9e9501afd50fc6d4d1a166.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_5d216a48f927f7c89bb8b2a9cbbbe875.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a19fd0971a49126885896ac504b4cf15.jpg',
                'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a06054d3db86a8b3fd5bf7c5b96493d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_002a22eea59684905fe2ca02f36c3279.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_09b16c3f9931db0df42ac7241d3ec4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_59a36cf4e9314522aad9915473d5b3ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_069f7c683d0aa4ce1f6eea60bff88656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_0999220a07c9dca90309c139243701b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_c643d0f464679495841acad91d7b96c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_43ec1c7e0a9e9501afd50fc6d4d1a166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_5d216a48f927f7c89bb8b2a9cbbbe875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a19fd0971a49126885896ac504b4cf15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e205ab4-26b7-517e-a4bf-5cd859a04f47/0e205ab4-26b7-517e-a4bf-5cd859a04f47_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/1d/571d7d4ddd6fd57f347734d0e03c5476/pa/CY78777_a06054d3db86a8b3fd5bf7c5b96493d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Karl 1.0 Exklusiv',
 'transmission': 'manual',
 'trim': 'Exklusiv',
 'year': 2015}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY78777%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.nl] INFO: Saving data for CY78777: {'created_time': 1774699833.047819, 'last_price_update_time': 1774699833.047828, 'auction_closing_time': 1774885492.0}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CY78777') HTTP/1.1" 204 0
2026-03-28 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-28 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d8bb91-00f7-5269-8245-353e68c0a4b7 with scrape type 1
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f6d8bb91-00f7-5269-8245-353e68c0a4b7
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F77%252Fdf7710a9b8c51e0e02a9397fd89e370a%252Fpa%252FDL13637_1aec60d2afd95739c4370045f93a55e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_1aec60d2afd95739c4370045f93a55e5.jpg already downloaded
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F77%252Fdf7710a9b8c51e0e02a9397fd89e370a%252Fpa%252FDL13637_e48ba51263410279a3b8a43c39e9013e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_e48ba51263410279a3b8a43c39e9013e.jpg already downloaded
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F77%252Fdf7710a9b8c51e0e02a9397fd89e370a%252Fpa%252FDL13637_603902c00971f10f2b7d7ccea44d8aec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_603902c00971f10f2b7d7ccea44d8aec.jpg already downloaded
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F77%252Fdf7710a9b8c51e0e02a9397fd89e370a%252Fpa%252FDL13637_d652a24f5968f031aed080f18780ac39.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_d652a24f5968f031aed080f18780ac39.jpg already downloaded
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F77%252Fdf7710a9b8c51e0e02a9397fd89e370a%252Fpa%252FDL13637_982e2b2f1a59c8c2d37ed57989626291.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_982e2b2f1a59c8c2d37ed57989626291.jpg already downloaded
2026-03-28 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6d8bb91-00f7-5269-8245-353e68c0a4b7, identifier: DL13637
2026-03-28 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-28 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 1
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg not downloaded yet
2026-03-28 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_c35916c4a3da625ab299a0ef03e71131.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-28 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637
2026-03-28 12:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6d8bb91-00f7-5269-8245-353e68c0a4b7 with identifier: DL13637 to the API
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL13637>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'f6d8bb91-00f7-5269-8245-353e68c0a4b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2KDS67',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL13637',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 300062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_1aec60d2afd95739c4370045f93a55e5.jpg',
                'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_e48ba51263410279a3b8a43c39e9013e.jpg',
                'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_603902c00971f10f2b7d7ccea44d8aec.jpg',
                'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_d652a24f5968f031aed080f18780ac39.jpg',
                'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_982e2b2f1a59c8c2d37ed57989626291.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6d8bb91-00f7-5269-8245-353e68c0a4b7/f6d8bb91-00f7-5269-8245-353e68c0a4b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_1aec60d2afd95739c4370045f93a55e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6d8bb91-00f7-5269-8245-353e68c0a4b7/f6d8bb91-00f7-5269-8245-353e68c0a4b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_e48ba51263410279a3b8a43c39e9013e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6d8bb91-00f7-5269-8245-353e68c0a4b7/f6d8bb91-00f7-5269-8245-353e68c0a4b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_603902c00971f10f2b7d7ccea44d8aec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6d8bb91-00f7-5269-8245-353e68c0a4b7/f6d8bb91-00f7-5269-8245-353e68c0a4b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_d652a24f5968f031aed080f18780ac39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6d8bb91-00f7-5269-8245-353e68c0a4b7/f6d8bb91-00f7-5269-8245-353e68c0a4b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/77/df7710a9b8c51e0e02a9397fd89e370a/pa/DL13637_982e2b2f1a59c8c2d37ed57989626291.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Citroen C1 1.0 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL13637%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [auto1.nl] INFO: Saving data for DL13637: {'created_time': 1774699833.720753, 'last_price_update_time': 1774699833.720766, 'auction_closing_time': 1774883824.0}
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DL13637') HTTP/1.1" 204 0
2026-03-28 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg not downloaded yet
2026-03-28 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YX65431> (referer: https://www.auto1.com/v1/car-details-view/YX65431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg not downloaded yet
2026-03-28 12:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a110490>
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_c35916c4a3da625ab299a0ef03e71131.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_c35916c4a3da625ab299a0ef03e71131.jpg saved to cache
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_9e2065a41a80652cece006409eaaec43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_9e2065a41a80652cece006409eaaec43.jpg not downloaded yet
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg not downloaded yet
2026-03-28 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg not downloaded yet
2026-03-28 12:10:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f59110>
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg saved to cache
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg not downloaded yet
2026-03-28 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG02230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-28 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 560dad57-a578-594f-b026-61aeb8198025 with scrape type 1
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 560dad57-a578-594f-b026-61aeb8198025
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_c77e92df0c2e40e9e6297d723d5ae0fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c77e92df0c2e40e9e6297d723d5ae0fe.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_a1f9f31eb5ec8c0526af9bf9d6f511f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_a1f9f31eb5ec8c0526af9bf9d6f511f0.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_18c3570f78e773d0aa2655a16a98334d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_18c3570f78e773d0aa2655a16a98334d.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_87fdde5424413107ce54189b96bf7383.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_87fdde5424413107ce54189b96bf7383.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_eadfd26e3ac620586cb2905bbbda9460.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_eadfd26e3ac620586cb2905bbbda9460.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_71db6c25dfc7cf5f1cced8d01b576e2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_71db6c25dfc7cf5f1cced8d01b576e2e.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_1913d1d96fc8050bb58fd7c26936ac04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_1913d1d96fc8050bb58fd7c26936ac04.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_bb994f80628edfcfd3eead051156dfc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_bb994f80628edfcfd3eead051156dfc8.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_9cac19dd09b3a7337d640ff6a0fd7bf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_9cac19dd09b3a7337d640ff6a0fd7bf8.jpg already downloaded
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fe8%252F8ee80c2f2c200dbfb59823c4e9f3e6f4%252Fpa%252FYX65431_c37b498ef6212b5ce5867c5eeb71e5f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c37b498ef6212b5ce5867c5eeb71e5f0.jpg already downloaded
2026-03-28 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 560dad57-a578-594f-b026-61aeb8198025, identifier: YX65431
2026-03-28 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913966cd50>
2026-03-28 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg saved to cache
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_b6da209953ea01849e56c6d2823360d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_b6da209953ea01849e56c6d2823360d4.jpg not downloaded yet
2026-03-28 12:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431
2026-03-28 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 560dad57-a578-594f-b026-61aeb8198025 with identifier: YX65431 to the API
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YX65431>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:10Z',
 'fuel_type': 'petrol',
 'id': '560dad57-a578-594f-b026-61aeb8198025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JD478X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX65431',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 275185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c77e92df0c2e40e9e6297d723d5ae0fe.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_a1f9f31eb5ec8c0526af9bf9d6f511f0.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_18c3570f78e773d0aa2655a16a98334d.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_87fdde5424413107ce54189b96bf7383.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_eadfd26e3ac620586cb2905bbbda9460.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_71db6c25dfc7cf5f1cced8d01b576e2e.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_1913d1d96fc8050bb58fd7c26936ac04.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_bb994f80628edfcfd3eead051156dfc8.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_9cac19dd09b3a7337d640ff6a0fd7bf8.jpg',
                'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c37b498ef6212b5ce5867c5eeb71e5f0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c77e92df0c2e40e9e6297d723d5ae0fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_a1f9f31eb5ec8c0526af9bf9d6f511f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_18c3570f78e773d0aa2655a16a98334d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_87fdde5424413107ce54189b96bf7383.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_eadfd26e3ac620586cb2905bbbda9460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_71db6c25dfc7cf5f1cced8d01b576e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_1913d1d96fc8050bb58fd7c26936ac04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_bb994f80628edfcfd3eead051156dfc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_9cac19dd09b3a7337d640ff6a0fd7bf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560dad57-a578-594f-b026-61aeb8198025/560dad57-a578-594f-b026-61aeb8198025_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/e8/8ee80c2f2c200dbfb59823c4e9f3e6f4/pa/YX65431_c37b498ef6212b5ce5867c5eeb71e5f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YX65431%27 HTTP/1.1" 200 None
2026-03-28 12:10:34 [auto1.nl] INFO: Saving data for YX65431: {'created_time': 1774699834.962894, 'last_price_update_time': 1774699834.962906, 'auction_closing_time': 1774884790.0}
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YX65431') HTTP/1.1" 204 0
2026-03-28 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg not downloaded yet
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY80321> (referer: https://www.auto1.com/v1/car-details-view/RY80321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395d6ad0>
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg saved to cache
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN49119> (referer: https://www.auto1.com/v1/car-details-view/WN49119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB82909> (referer: https://www.auto1.com/v1/car-details-view/FB82909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg not downloaded yet
2026-03-28 12:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951f790>
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg saved to cache
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a with scrape type 1
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53762ab1-1094-5a33-9bbb-cfe686d3a64a
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_7386d63faabac7086c2410c226f36883.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7386d63faabac7086c2410c226f36883.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_e0b176309bcd74334820dacfe6c5ba43.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_e0b176309bcd74334820dacfe6c5ba43.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_d562a0069e1146763973f17c8bf5b637.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_d562a0069e1146763973f17c8bf5b637.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_f1bed9b3fd1ab7ead90728b23eae1419.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f1bed9b3fd1ab7ead90728b23eae1419.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_81bfc074dd515f0b51b3d277465e95a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_81bfc074dd515f0b51b3d277465e95a3.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_55d4ee5602b0c1ae46140c2f05227436.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_55d4ee5602b0c1ae46140c2f05227436.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_0ba184a91194c48df2f73390f97afbff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_0ba184a91194c48df2f73390f97afbff.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_1aa5bd515d7aa17e444be5206ba60dc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_1aa5bd515d7aa17e444be5206ba60dc0.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_f769e54ff42c648ad66f8575fa5691f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f769e54ff42c648ad66f8575fa5691f9.jpg already downloaded
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F06%252F3506bcb64c03f5e2d1918bd2a12722ad%252Fpa%252FRY80321_7f22744b5d4a15780c7310a3bc57683d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7f22744b5d4a15780c7310a3bc57683d.jpg already downloaded
2026-03-28 12:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53762ab1-1094-5a33-9bbb-cfe686d3a64a, identifier: RY80321
2026-03-28 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321
2026-03-28 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53762ab1-1094-5a33-9bbb-cfe686d3a64a with identifier: RY80321 to the API
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY80321>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:05:41Z',
 'fuel_type': 'diesel',
 'id': '53762ab1-1094-5a33-9bbb-cfe686d3a64a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2XKV42',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY80321',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 289995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7386d63faabac7086c2410c226f36883.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_e0b176309bcd74334820dacfe6c5ba43.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_d562a0069e1146763973f17c8bf5b637.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f1bed9b3fd1ab7ead90728b23eae1419.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_81bfc074dd515f0b51b3d277465e95a3.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_55d4ee5602b0c1ae46140c2f05227436.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_0ba184a91194c48df2f73390f97afbff.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_1aa5bd515d7aa17e444be5206ba60dc0.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f769e54ff42c648ad66f8575fa5691f9.jpg',
                'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7f22744b5d4a15780c7310a3bc57683d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2163066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7386d63faabac7086c2410c226f36883.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_e0b176309bcd74334820dacfe6c5ba43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_d562a0069e1146763973f17c8bf5b637.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f1bed9b3fd1ab7ead90728b23eae1419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_81bfc074dd515f0b51b3d277465e95a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2106440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_55d4ee5602b0c1ae46140c2f05227436.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2019077,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_0ba184a91194c48df2f73390f97afbff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_1aa5bd515d7aa17e444be5206ba60dc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_f769e54ff42c648ad66f8575fa5691f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53762ab1-1094-5a33-9bbb-cfe686d3a64a/53762ab1-1094-5a33-9bbb-cfe686d3a64a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/06/3506bcb64c03f5e2d1918bd2a12722ad/pa/RY80321_7f22744b5d4a15780c7310a3bc57683d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI GreenLine',
 'transmission': 'manual',
 'trim': 'GreenLine',
 'year': 2014}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY80321%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [auto1.nl] INFO: Saving data for RY80321: {'created_time': 1774699835.913988, 'last_price_update_time': 1774699835.914, 'auction_closing_time': 1774883141.0}
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY80321') HTTP/1.1" 204 0
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_9e2065a41a80652cece006409eaaec43.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV92208> (referer: https://www.auto1.com/v1/car-details-view/HV92208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ86515> (referer: https://www.auto1.com/v1/car-details-view/NZ86515/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 1
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg not downloaded yet
2026-03-28 12:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-28 12:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 1
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg not downloaded yet
2026-03-28 12:10:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a08de90>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_0091ed5ffe158519e840363814e55238.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_0091ed5ffe158519e840363814e55238.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_76e3c985957776af579bdfa0197a700f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_76e3c985957776af579bdfa0197a700f.jpg not downloaded yet
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a017590>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913967ca50>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913bef1650>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_9e2065a41a80652cece006409eaaec43.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_9e2065a41a80652cece006409eaaec43.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-28 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 1
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_b8fd4f77b9a88f50626b7f294db83792.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b8fd4f77b9a88f50626b7f294db83792.jpg not downloaded yet
2026-03-28 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-28 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 1
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_10252a494b497568212f1876d8b2b663.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_10252a494b497568212f1876d8b2b663.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_61453fff6a41b58f7bef295f6965e6c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_fb324dc53b91d91d76c890e3f1121432.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_fb324dc53b91d91d76c890e3f1121432.jpg not downloaded yet
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f0ee50>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_7125322d4014da42aa952f86b67794c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_b3f8ed9921bc4c00c708bec023032da1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b3f8ed9921bc4c00c708bec023032da1.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_09ef9ca42b90e48e24d130553554c59d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_09ef9ca42b90e48e24d130553554c59d.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_04575f5107474b97c1aaab313d2cd8d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_04575f5107474b97c1aaab313d2cd8d5.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_8472fc68552b210a8eac6efff0796239.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_8472fc68552b210a8eac6efff0796239.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_e05c5559502fdc363a66d843c7fefe73.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_e05c5559502fdc363a66d843c7fefe73.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_179b4e73f786bff84ab721add0b3ca91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_74ffba9bfa2493bf3b64f33d708884de.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_74ffba9bfa2493bf3b64f33d708884de.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_448abba6d07856cca58014961bb6acc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_448abba6d07856cca58014961bb6acc7.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg not downloaded yet
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB36156> (referer: https://www.auto1.com/v1/car-details-view/AB36156/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395cfe50>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139579ad0>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913956c950>
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_61453fff6a41b58f7bef295f6965e6c6.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_61453fff6a41b58f7bef295f6965e6c6.jpg saved to cache
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_76e3c985957776af579bdfa0197a700f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg not downloaded yet
2026-03-28 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_d473c0747e2d810be6957d91216e8069.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_d473c0747e2d810be6957d91216e8069.jpg not downloaded yet
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_7aea3030a9b543474a76d961ecccac67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_7aea3030a9b543474a76d961ecccac67.jpg not downloaded yet
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395c9890>
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_7125322d4014da42aa952f86b67794c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_7125322d4014da42aa952f86b67794c1.jpg saved to cache
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_cab10e1754918fb73628778b7441867a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_cab10e1754918fb73628778b7441867a.jpg not downloaded yet
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg not downloaded yet
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG02230> (referer: https://www.auto1.com/v1/car-details-view/FG02230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg not downloaded yet
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB39700> (referer: https://www.auto1.com/v1/car-details-view/JB39700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_09ef9ca42b90e48e24d130553554c59d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_c60c6440089aee51404e697490d6008c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_c60c6440089aee51404e697490d6008c.jpg not downloaded yet
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394ba890>
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg saved to cache
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b6710>
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg saved to cache
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139414dd0>
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_179b4e73f786bff84ab721add0b3ca91.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_179b4e73f786bff84ab721add0b3ca91.jpg saved to cache
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ecf8d0>
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F07%252F390726dc3f3c724572a7e81995b45159%252Fpa%252FXM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg saved to cache
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5d54751-09fa-59ea-8510-0959d073654d
2026-03-28 12:10:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5d54751-09fa-59ea-8510-0959d073654d, skipping ID generation
2026-03-28 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5d54751-09fa-59ea-8510-0959d073654d with scrape type 1
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5d54751-09fa-59ea-8510-0959d073654d sending to next pipeline
2026-03-28 12:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5d54751-09fa-59ea-8510-0959d073654d, identifier: XM87869
2026-03-28 12:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-28 12:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 1
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_53865b41504829ce0dcaa3de515bba09.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_53865b41504829ce0dcaa3de515bba09.jpg not downloaded yet
2026-03-28 12:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NX59327> (referer: https://www.auto1.com/v1/car-details-view/NX59327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869
2026-03-28 12:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5d54751-09fa-59ea-8510-0959d073654d with identifier: XM87869 to the API
2026-03-28 12:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:47:16Z',
 'fuel_type': 'petrol',
 'id': 'e5d54751-09fa-59ea-8510-0959d073654d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7SVS22',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM87869',
 'listing': 'auction',
 'location': 'NL, Amsterdam',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 250938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3139529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_7d764169b987922b54a0059411cd9bf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_61453fff6a41b58f7bef295f6965e6c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2907904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_fac14bb6aff3a4df1c62e86407120fc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_179b4e73f786bff84ab721add0b3ca91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d2a23c6cd568f7d827e20a6ad8b76ac1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_c35916c4a3da625ab299a0ef03e71131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_df5bbf284ea702ceb6bc483bb37f9fd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3154765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_1b8c84a8c4bddb552b14833ccc8e706c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_cd8654b2207f32c126e6d3deebafd616.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5d54751-09fa-59ea-8510-0959d073654d/e5d54751-09fa-59ea-8510-0959d073654d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/07/390726dc3f3c724572a7e81995b45159/pa/XM87869_d29056f77b7463f025e6b0929ad2a688.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XM87869%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [auto1.nl] INFO: Saving data for XM87869: {'created_time': 1774699839.09976, 'last_price_update_time': 1774699839.099771, 'auction_closing_time': 1774885636.0}
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XM87869') HTTP/1.1" 204 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_895d1cc31c4eff403d6131049036c281.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_895d1cc31c4eff403d6131049036c281.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_91e74e7b88075a175745e88753b69c83.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_91e74e7b88075a175745e88753b69c83.jpg not downloaded yet
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ece4d0>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_76e3c985957776af579bdfa0197a700f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_76e3c985957776af579bdfa0197a700f.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b7a50>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394f4750>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-28 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 1
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_d45b7028dd7445a020b4b97da9013ac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_d45b7028dd7445a020b4b97da9013ac5.jpg not downloaded yet
2026-03-28 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-28 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 1
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg not downloaded yet
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a06dad0>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_09ef9ca42b90e48e24d130553554c59d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_09ef9ca42b90e48e24d130553554c59d.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_afb2ed3af644080e698e5659ac13e4ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_afb2ed3af644080e698e5659ac13e4ac.jpg not downloaded yet
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg not downloaded yet
2026-03-28 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-28 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 1
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_d507f0265579be319d8b266bfa94e354.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_d507f0265579be319d8b266bfa94e354.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_5a3917147d3c0f6c5bc11a5338725091.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_5a3917147d3c0f6c5bc11a5338725091.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg not downloaded yet
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_53865b41504829ce0dcaa3de515bba09.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_91e74e7b88075a175745e88753b69c83.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_2aead830e52193d43719f5a7797183d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2aead830e52193d43719f5a7797183d9.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_404ab1df67c46e0c3eca4f27a674e521.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_404ab1df67c46e0c3eca4f27a674e521.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg not downloaded yet
2026-03-28 12:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913addfb50>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_c60c6440089aee51404e697490d6008c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_eef53553bb79e9b15ab128aa524f1759.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_eef53553bb79e9b15ab128aa524f1759.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_1e377fef2bb8b9f52257a55e656afd01.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1e377fef2bb8b9f52257a55e656afd01.jpg not downloaded yet
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_895d1cc31c4eff403d6131049036c281.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_b6da209953ea01849e56c6d2823360d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_d24dc307b299caf5d2ec25025f1be009.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_d24dc307b299caf5d2ec25025f1be009.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg not downloaded yet
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139636190>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_53865b41504829ce0dcaa3de515bba09.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_53865b41504829ce0dcaa3de515bba09.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a13b0d0>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_91e74e7b88075a175745e88753b69c83.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_91e74e7b88075a175745e88753b69c83.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139640510>
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg saved to cache
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg not downloaded yet
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg not downloaded yet
2026-03-28 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_cab10e1754918fb73628778b7441867a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_7aea3030a9b543474a76d961ecccac67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg not downloaded yet
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg not downloaded yet
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_b4ee90502e715b75977b28f54fa866b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_b4ee90502e715b75977b28f54fa866b4.jpg not downloaded yet
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg not downloaded yet
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a13af90>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_c60c6440089aee51404e697490d6008c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_c60c6440089aee51404e697490d6008c.jpg saved to cache
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961ba10>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_895d1cc31c4eff403d6131049036c281.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_895d1cc31c4eff403d6131049036c281.jpg saved to cache
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fa5390>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ffb%252F40fb6d49885e222fc7b1ee6f3ad7d467%252Fpa%252FMZ74119_b6da209953ea01849e56c6d2823360d4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_b6da209953ea01849e56c6d2823360d4.jpg saved to cache
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c
2026-03-28 12:10:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebba39ab-1cd4-54bf-94e1-c098c9f4099c, skipping ID generation
2026-03-28 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c with scrape type 1
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebba39ab-1cd4-54bf-94e1-c098c9f4099c sending to next pipeline
2026-03-28 12:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ebba39ab-1cd4-54bf-94e1-c098c9f4099c, identifier: MZ74119
2026-03-28 12:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-28 12:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119
2026-03-28 12:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ebba39ab-1cd4-54bf-94e1-c098c9f4099c with identifier: MZ74119 to the API
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_b6da209953ea01849e56c6d2823360d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:56:06Z',
 'fuel_type': 'diesel',
 'id': 'ebba39ab-1cd4-54bf-94e1-c098c9f4099c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'G473LH',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ74119',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'BMW',
 'model': '5er',
 'odometer': 256902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_ecdb6a28bfbcf91f0dfde2030c6af60e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_3dc8051e0ceafc8dbf446a2dfe4110b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_86f45a51ad3eedb3c9f6aacae54a9998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_9e2065a41a80652cece006409eaaec43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_c2c894b057b2bfb111919e96b8a0e961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_8a7fd6025bc2c0a6247dab3d562189c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_39ed3ff54ac274ff2d81a9a3ca33eb4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2212138,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_b6da209953ea01849e56c6d2823360d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_524b3ae7a434d43b5e5be5ad32b2e820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebba39ab-1cd4-54bf-94e1-c098c9f4099c/ebba39ab-1cd4-54bf-94e1-c098c9f4099c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/fb/40fb6d49885e222fc7b1ee6f3ad7d467/pa/MZ74119_d3c07b632bdc0e99fe9648d2678595e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ74119%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [auto1.nl] INFO: Saving data for MZ74119: {'created_time': 1774699840.822941, 'last_price_update_time': 1774699840.82295, 'auction_closing_time': 1774886166.0}
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ74119') HTTP/1.1" 204 0
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_727d8a22368b9efa0b676ba19cb19c07.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_727d8a22368b9efa0b676ba19cb19c07.jpg not downloaded yet
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_5a3917147d3c0f6c5bc11a5338725091.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f24b10>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_cab10e1754918fb73628778b7441867a.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_cab10e1754918fb73628778b7441867a.jpg saved to cache
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395f5a50>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_7aea3030a9b543474a76d961ecccac67.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_7aea3030a9b543474a76d961ecccac67.jpg saved to cache
2026-03-28 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139635d10>
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393cb310>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1e377fef2bb8b9f52257a55e656afd01.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_404ab1df67c46e0c3eca4f27a674e521.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1cc210>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139545390>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fb2250>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_5a3917147d3c0f6c5bc11a5338725091.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_5a3917147d3c0f6c5bc11a5338725091.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913befec50>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a196550>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_1e377fef2bb8b9f52257a55e656afd01.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1e377fef2bb8b9f52257a55e656afd01.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b70d0>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_404ab1df67c46e0c3eca4f27a674e521.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_404ab1df67c46e0c3eca4f27a674e521.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_fb324dc53b91d91d76c890e3f1121432.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f5c190>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a16f390>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_727d8a22368b9efa0b676ba19cb19c07.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961dbd0>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_fb324dc53b91d91d76c890e3f1121432.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_fb324dc53b91d91d76c890e3f1121432.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f4f350>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a194410>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_d24dc307b299caf5d2ec25025f1be009.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_b4ee90502e715b75977b28f54fa866b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_eef53553bb79e9b15ab128aa524f1759.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f35850>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_727d8a22368b9efa0b676ba19cb19c07.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_727d8a22368b9efa0b676ba19cb19c07.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_d473c0747e2d810be6957d91216e8069.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_d507f0265579be319d8b266bfa94e354.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913942e910>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_d24dc307b299caf5d2ec25025f1be009.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_d24dc307b299caf5d2ec25025f1be009.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_afb2ed3af644080e698e5659ac13e4ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f27a90>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_b4ee90502e715b75977b28f54fa866b4.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_b4ee90502e715b75977b28f54fa866b4.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394172d0>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_eef53553bb79e9b15ab128aa524f1759.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_eef53553bb79e9b15ab128aa524f1759.jpg saved to cache
2026-03-28 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139616b90>
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139416150>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_d473c0747e2d810be6957d91216e8069.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_d473c0747e2d810be6957d91216e8069.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139428fd0>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139417050>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139417210>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f39090>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2aead830e52193d43719f5a7797183d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_d45b7028dd7445a020b4b97da9013ac5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fbafd0>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_d507f0265579be319d8b266bfa94e354.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_d507f0265579be319d8b266bfa94e354.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a061d50>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139625ad0>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393c5390>
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fa6%252F85a612f3ae40e9902893139508fdf47d%252Fpa%252FAB36156_afb2ed3af644080e698e5659ac13e4ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_afb2ed3af644080e698e5659ac13e4ac.jpg saved to cache
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f
2026-03-28 12:10:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f, skipping ID generation
2026-03-28 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with scrape type 1
2026-03-28 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f sending to next pipeline
2026-03-28 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f, identifier: AB36156
2026-03-28 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-28 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156
2026-03-28 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f with identifier: AB36156 to the API
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_afb2ed3af644080e698e5659ac13e4ac.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': 'f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KL696R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB36156',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 213258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_53865b41504829ce0dcaa3de515bba09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_91e74e7b88075a175745e88753b69c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_afb2ed3af644080e698e5659ac13e4ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f/f36ff6d8-534d-54ee-a8c7-378ac8fb0b8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/a6/85a612f3ae40e9902893139508fdf47d/pa/AB36156_d507f0265579be319d8b266bfa94e354.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2005}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB36156%27 HTTP/1.1" 200 None
2026-03-28 12:10:43 [auto1.nl] INFO: Saving data for AB36156: {'created_time': 1774699843.305749, 'last_price_update_time': 1774699843.305759, 'auction_closing_time': 1774884777.0}
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB36156') HTTP/1.1" 204 0
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139626f50>
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_2aead830e52193d43719f5a7797183d9.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2aead830e52193d43719f5a7797183d9.jpg saved to cache
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1edb10>
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg saved to cache
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139511310>
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F75%252Fbb75341d5c589c0fd3d02b5c1fb3d7eb%252Fpa%252FJB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg saved to cache
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02af6e8a-f01d-5d65-a501-61c7afbe6337
2026-03-28 12:10:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02af6e8a-f01d-5d65-a501-61c7afbe6337, skipping ID generation
2026-03-28 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 with scrape type 1
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02af6e8a-f01d-5d65-a501-61c7afbe6337 sending to next pipeline
2026-03-28 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02af6e8a-f01d-5d65-a501-61c7afbe6337, identifier: JB39700
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139522c90>
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F9c%252Ff89cf7e13df7e39b88534744aba8ab11%252Fpa%252FFG02230_d45b7028dd7445a020b4b97da9013ac5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_d45b7028dd7445a020b4b97da9013ac5.jpg saved to cache
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64e94fe0-a429-51cb-a874-beabf2585ea2
2026-03-28 12:10:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64e94fe0-a429-51cb-a874-beabf2585ea2, skipping ID generation
2026-03-28 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64e94fe0-a429-51cb-a874-beabf2585ea2 with scrape type 1
2026-03-28 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64e94fe0-a429-51cb-a874-beabf2585ea2 sending to next pipeline
2026-03-28 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 64e94fe0-a429-51cb-a874-beabf2585ea2, identifier: FG02230
2026-03-28 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700
2026-03-28 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02af6e8a-f01d-5d65-a501-61c7afbe6337 with identifier: JB39700 to the API
2026-03-28 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'petrol',
 'id': '02af6e8a-f01d-5d65-a501-61c7afbe6337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 's635nv',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB39700',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 154505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2990193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_0b5002b49ea0c426b7fdaf376d7ac1d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_5e8d165bdbbb0c442c6f8d262c95043f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_587cb9e55159c0a430b7179d6d63f5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3061321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_4ce47fe6d9f5abd8bdd92b4d3b7e2baa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_404ab1df67c46e0c3eca4f27a674e521.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_eef53553bb79e9b15ab128aa524f1759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_d24dc307b299caf5d2ec25025f1be009.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_05e8ab4b22f400cd8f1f13b7c52cf060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1081749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_6e7b5460924cd8d4a7dc22cd22061444.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02af6e8a-f01d-5d65-a501-61c7afbe6337/02af6e8a-f01d-5d65-a501-61c7afbe6337_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/75/bb75341d5c589c0fd3d02b5c1fb3d7eb/pa/JB39700_b4ee90502e715b75977b28f54fa866b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB39700%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.nl] INFO: Saving data for JB39700: {'created_time': 1774699844.170694, 'last_price_update_time': 1774699844.170708, 'auction_closing_time': 1774883052.0}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB39700') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-28 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230
2026-03-28 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 64e94fe0-a429-51cb-a874-beabf2585ea2 with identifier: FG02230 to the API
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_d45b7028dd7445a020b4b97da9013ac5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:21Z',
 'fuel_type': 'petrol',
 'id': '64e94fe0-a429-51cb-a874-beabf2585ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '95KXF1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG02230',
 'listing': 'auction',
 'location': 'NL, Tilburg',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 178651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_d45b7028dd7445a020b4b97da9013ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2e4ff76cfc37f46e76bc6d8734e01672.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_61f4820a7fd899d49a8f320f5acbcb95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_5a3917147d3c0f6c5bc11a5338725091.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64e94fe0-a429-51cb-a874-beabf2585ea2/64e94fe0-a429-51cb-a874-beabf2585ea2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/9c/f89cf7e13df7e39b88534744aba8ab11/pa/FG02230_2aead830e52193d43719f5a7797183d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2010}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG02230%27 HTTP/1.1" 200 None
2026-03-28 12:10:44 [auto1.nl] INFO: Saving data for FG02230: {'created_time': 1774699844.5519, 'last_price_update_time': 1774699844.551913, 'auction_closing_time': 1774885701.0}
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FG02230') HTTP/1.1" 204 0
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_74ffba9bfa2493bf3b64f33d708884de.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_04575f5107474b97c1aaab313d2cd8d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_e05c5559502fdc363a66d843c7fefe73.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_8472fc68552b210a8eac6efff0796239.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WK03460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_448abba6d07856cca58014961bb6acc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_0091ed5ffe158519e840363814e55238.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b8fd4f77b9a88f50626b7f294db83792.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139edf090>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_74ffba9bfa2493bf3b64f33d708884de.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_74ffba9bfa2493bf3b64f33d708884de.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_e051ad286fd3f36dcbedb903df96747d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_42180fbe313a2347f7cad24114d98bbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393e1ed0>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139eefed0>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f0e8d0>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_04575f5107474b97c1aaab313d2cd8d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_04575f5107474b97c1aaab313d2cd8d5.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd6910>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_e05c5559502fdc363a66d843c7fefe73.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_e05c5559502fdc363a66d843c7fefe73.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913adef090>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_8472fc68552b210a8eac6efff0796239.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_8472fc68552b210a8eac6efff0796239.jpg saved to cache
2026-03-28 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f22450>
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F24%252Fb3247cc445558301a1dbc77b22c55f39%252Fpa%252FNX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg saved to cache
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0
2026-03-28 12:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0, skipping ID generation
2026-03-28 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with scrape type 1
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 sending to next pipeline
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0, identifier: NX59327
2026-03-28 12:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395111d0>
2026-03-28 12:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9b%252F13%252F9b134d7ebda3eddd22fda55346f2808c%252Fpa%252FFB82909_448abba6d07856cca58014961bb6acc7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_448abba6d07856cca58014961bb6acc7.jpg saved to cache
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4342915f-5ba8-550a-84d2-cde7b5252675
2026-03-28 12:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4342915f-5ba8-550a-84d2-cde7b5252675, skipping ID generation
2026-03-28 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4342915f-5ba8-550a-84d2-cde7b5252675 with scrape type 1
2026-03-28 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4342915f-5ba8-550a-84d2-cde7b5252675 sending to next pipeline
2026-03-28 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4342915f-5ba8-550a-84d2-cde7b5252675, identifier: FB82909
2026-03-28 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b3f8ed9921bc4c00c708bec023032da1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-28 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327
2026-03-28 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0 with identifier: NX59327 to the API
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'petrol',
 'id': '9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JLV14L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX59327',
 'listing': 'auction',
 'location': 'NL, Hoofddorp',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 83312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479502,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1076d3a6d5c1f05c963fa0907d9d2600.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_c5f003c13b7bc1293cbc09820fc6ef6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_46a4810e30ade431ec79d9fd862ae8cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_2c9d2ae0e70dd3750a57b57ab540f75c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_1e377fef2bb8b9f52257a55e656afd01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a2f285ebcc4df330b0fd60b558ca27bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_a7f6c91ebe381ebef3d083d1e1723457.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_3654b187f2758afc9ea8d33ba0ef8ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_b7a3a429077a6fa59fccbdad57de88a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0/9c8ea0dd-d9c3-55d6-a7d5-a49536086ad0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/24/b3247cc445558301a1dbc77b22c55f39/pa/NX59327_727d8a22368b9efa0b676ba19cb19c07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2016}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX59327%27 HTTP/1.1" 200 None
2026-03-28 12:10:45 [auto1.nl] INFO: Saving data for NX59327: {'created_time': 1774699845.748042, 'last_price_update_time': 1774699845.748051, 'auction_closing_time': 1774883723.0}
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX59327') HTTP/1.1" 204 0
2026-03-28 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-28 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909
2026-03-28 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4342915f-5ba8-550a-84d2-cde7b5252675 with identifier: FB82909 to the API
2026-03-28 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_448abba6d07856cca58014961bb6acc7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': '4342915f-5ba8-550a-84d2-cde7b5252675',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N089FG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB82909',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Fiat',
 'model': '500',
 'odometer': 53781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_b6fec8620ecf17b6cd28ddc619f963ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_76e3c985957776af579bdfa0197a700f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_e00a335dfda8e1db7fb21e5d3301a2e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459489,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_fb324dc53b91d91d76c890e3f1121432.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_04575f5107474b97c1aaab313d2cd8d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_448abba6d07856cca58014961bb6acc7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_d473c0747e2d810be6957d91216e8069.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_efa1e6c9bb7b6ccd1258a3ac0b1fc8b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_c60c6440089aee51404e697490d6008c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4342915f-5ba8-550a-84d2-cde7b5252675/4342915f-5ba8-550a-84d2-cde7b5252675_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9b/13/9b134d7ebda3eddd22fda55346f2808c/pa/FB82909_895d1cc31c4eff403d6131049036c281.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'automatic',
 'trim': 'Pop Star',
 'year': 2018}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB82909%27 HTTP/1.1" 200 None
2026-03-28 12:10:46 [auto1.nl] INFO: Saving data for FB82909: {'created_time': 1774699846.124418, 'last_price_update_time': 1774699846.124431, 'auction_closing_time': 1774883431.0}
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB82909') HTTP/1.1" 204 0
2026-03-28 12:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_10252a494b497568212f1876d8b2b663.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139550ed0>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913941c810>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91396247d0>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a11a110>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fbd%252F3bbd7640210b0bcaa8261afc06fd9049%252Fpa%252FNZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16
2026-03-28 12:10:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16, skipping ID generation
2026-03-28 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with scrape type 1
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 sending to next pipeline
2026-03-28 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16, identifier: NZ86515
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139568190>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Ff3%252F40f39cd23e819c38fe1b0154d7526978%252Fpa%252FWN49119_0091ed5ffe158519e840363814e55238.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_0091ed5ffe158519e840363814e55238.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a466afae-1dfc-5d72-990e-54c8afcbbf86
2026-03-28 12:10:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a466afae-1dfc-5d72-990e-54c8afcbbf86, skipping ID generation
2026-03-28 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a466afae-1dfc-5d72-990e-54c8afcbbf86 with scrape type 1
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a466afae-1dfc-5d72-990e-54c8afcbbf86 sending to next pipeline
2026-03-28 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a466afae-1dfc-5d72-990e-54c8afcbbf86, identifier: WN49119
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913941c190>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_b8fd4f77b9a88f50626b7f294db83792.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b8fd4f77b9a88f50626b7f294db83792.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1eebd0>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_e051ad286fd3f36dcbedb903df96747d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_e051ad286fd3f36dcbedb903df96747d.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0e7d10>
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F13%252Fd613b9d6b97c8f89ee93de8a3fd39b1a%252Fpa%252FPA65227_42180fbe313a2347f7cad24114d98bbb.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_42180fbe313a2347f7cad24114d98bbb.jpg saved to cache
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e07038d-6030-54c4-8294-d15ea6a252ea
2026-03-28 12:10:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e07038d-6030-54c4-8294-d15ea6a252ea, skipping ID generation
2026-03-28 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e07038d-6030-54c4-8294-d15ea6a252ea with scrape type 1
2026-03-28 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e07038d-6030-54c4-8294-d15ea6a252ea sending to next pipeline
2026-03-28 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e07038d-6030-54c4-8294-d15ea6a252ea, identifier: PA65227
2026-03-28 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 12:10:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515
2026-03-28 12:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f083ca3-4849-5d2d-bb2b-de72c97f2e16 with identifier: NZ86515 to the API
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'petrol',
 'id': '8f083ca3-4849-5d2d-bb2b-de72c97f2e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JG903G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ86515',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 107063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_0c4ef8d87e39d0cf5f0bb430724cff38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_c8638dbf6097842907bc0d0daf4129cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_09ef9ca42b90e48e24d130553554c59d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_e05c5559502fdc363a66d843c7fefe73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f083ca3-4849-5d2d-bb2b-de72c97f2e16/8f083ca3-4849-5d2d-bb2b-de72c97f2e16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/bd/3bbd7640210b0bcaa8261afc06fd9049/pa/NZ86515_95eba9e6d4ad16f642912b68fbba7b91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2013}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ86515%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.nl] INFO: Saving data for NZ86515: {'created_time': 1774699848.100193, 'last_price_update_time': 1774699848.100203, 'auction_closing_time': 1774882872.0}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ86515') HTTP/1.1" 204 0
2026-03-28 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-28 12:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119
2026-03-28 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a466afae-1dfc-5d72-990e-54c8afcbbf86 with identifier: WN49119 to the API
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_0091ed5ffe158519e840363814e55238.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:27:51Z',
 'fuel_type': 'hybrid',
 'id': 'a466afae-1dfc-5d72-990e-54c8afcbbf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN49119',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 187001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63109,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_8c0d4acac6d3fe18e70833e8590da4bc.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63885,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_0091ed5ffe158519e840363814e55238.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63041,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_47442a4cd9b32d6d2120f392d289f0bb.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65498,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_d907e1a6a63220ff3c0e142d9c0c1178.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56981,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_3a637e7bb28d4252a67f675ec8ddf6f2.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57984,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_74ffba9bfa2493bf3b64f33d708884de.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69696,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_ab0a650496b4809b8ec3605f049d2ed7.jpg',
             'Width': 720},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a466afae-1dfc-5d72-990e-54c8afcbbf86/a466afae-1dfc-5d72-990e-54c8afcbbf86_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57303,
             'Height': 540,
             'OriginUrl': 'https://img-pa.auto1.com/img40/f3/40f39cd23e819c38fe1b0154d7526978/pa/WN49119_cab10e1754918fb73628778b7441867a.jpg',
             'Width': 720}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN49119%27 HTTP/1.1" 200 None
2026-03-28 12:10:48 [auto1.nl] INFO: Saving data for WN49119: {'created_time': 1774699848.527156, 'last_price_update_time': 1774699848.527166, 'auction_closing_time': 1774884471.0}
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN49119') HTTP/1.1" 204 0
2026-03-28 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 12:10:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227
2026-03-28 12:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e07038d-6030-54c4-8294-d15ea6a252ea with identifier: PA65227 to the API
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_42180fbe313a2347f7cad24114d98bbb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:11:31Z',
 'fuel_type': 'electro',
 'id': '1e07038d-6030-54c4-8294-d15ea6a252ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA65227',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'eVito',
 'odometer': 82128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_621c2791132ba11d2c0fafd807e3c229.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_93d4efd6e45689931724697c61ac217a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_42180fbe313a2347f7cad24114d98bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_fcc339c65add137b262c62c85f8b5162.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_7125322d4014da42aa952f86b67794c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6c02f462cdd1dfa70b36aaf3cab6ee34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_b461dbff32e8ebba6adaaf03de773ab4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e07038d-6030-54c4-8294-d15ea6a252ea/1e07038d-6030-54c4-8294-d15ea6a252ea_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 192075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/13/d613b9d6b97c8f89ee93de8a3fd39b1a/pa/PA65227_6310e401ed5c9f9d050d0a45f8c61af3.png',
             'Width': 424}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz eVito electric drive 85 kW lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2024}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA65227%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.nl] INFO: Saving data for PA65227: {'created_time': 1774699849.036224, 'last_price_update_time': 1774699849.036232, 'auction_closing_time': 1774883491.0}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA65227') HTTP/1.1" 204 0
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a118590>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_b3f8ed9921bc4c00c708bec023032da1.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b3f8ed9921bc4c00c708bec023032da1.jpg saved to cache
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK13348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139446090>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fe7%252F73e70de35dc9d43143331017f2478256%252Fpa%252FHV92208_10252a494b497568212f1876d8b2b663.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_10252a494b497568212f1876d8b2b663.jpg saved to cache
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5
2026-03-28 12:10:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5, skipping ID generation
2026-03-28 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with scrape type 1
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 sending to next pipeline
2026-03-28 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5, identifier: HV92208
2026-03-28 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-28 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208
2026-03-28 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5 with identifier: HV92208 to the API
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_10252a494b497568212f1876d8b2b663.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': 'a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV92208',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 46843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b8fd4f77b9a88f50626b7f294db83792.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_10252a494b497568212f1876d8b2b663.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341482,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_b3f8ed9921bc4c00c708bec023032da1.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_8472fc68552b210a8eac6efff0796239.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99979,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_c9954a55cb9c0966b2dc0948e2e3e108.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_7aea3030a9b543474a76d961ecccac67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5/a29d2b74-dfa9-5ee9-b3b0-b230dd6c15e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104851,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img73/e7/73e70de35dc9d43143331017f2478256/pa/HV92208_a23385bbd42a702f3f902b5b0ed0cf0d.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2024}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV92208%27 HTTP/1.1" 200 None
2026-03-28 12:10:49 [auto1.nl] INFO: Saving data for HV92208: {'created_time': 1774699849.651587, 'last_price_update_time': 1774699849.651596, 'auction_closing_time': 1774885985.0}
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV92208') HTTP/1.1" 204 0
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_9ac379537c247c7f743d096d173f26a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_51a8949f36fd444e9b4194c372c0f55c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_0eba9397625175a88e9827f9c796a468.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_b49fc48578b3aaf99c373be2591e24b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_4b89f5d5904db28780e033203e5b642b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_18063db927cfe4ffa4cb282bbadff121.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139465c90>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg saved to cache
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fa4550>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg saved to cache
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_3221544202279b16f6da1a8bd8a96836.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139445490>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg saved to cache
2026-03-28 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a016e90>
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f54250>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_9ac379537c247c7f743d096d173f26a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_9ac379537c247c7f743d096d173f26a6.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91396400d0>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_51a8949f36fd444e9b4194c372c0f55c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_51a8949f36fd444e9b4194c372c0f55c.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913939d010>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_0eba9397625175a88e9827f9c796a468.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_0eba9397625175a88e9827f9c796a468.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a015f10>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252F78%252F28785e3550d6888a9516f3445da18163%252Fpa%252FJM32164_b49fc48578b3aaf99c373be2591e24b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_b49fc48578b3aaf99c373be2591e24b5.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe
2026-03-28 12:10:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe, skipping ID generation
2026-03-28 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with scrape type 1
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe sending to next pipeline
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe, identifier: JM32164
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139447290>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913967ea10>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139eeedd0>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ff0%252Fdef06ad28fb530f7ae4b8705715f79bc%252Fpa%252FSE67800_4b89f5d5904db28780e033203e5b642b.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_4b89f5d5904db28780e033203e5b642b.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d88977c0-4d35-544c-b133-257b8d5a731b
2026-03-28 12:10:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d88977c0-4d35-544c-b133-257b8d5a731b, skipping ID generation
2026-03-28 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d88977c0-4d35-544c-b133-257b8d5a731b with scrape type 1
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d88977c0-4d35-544c-b133-257b8d5a731b sending to next pipeline
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d88977c0-4d35-544c-b133-257b8d5a731b, identifier: SE67800
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139472090>
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F79%252Fd679979f05adecf655ee991c5df08f9e%252Fpa%252FME24209_18063db927cfe4ffa4cb282bbadff121.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_18063db927cfe4ffa4cb282bbadff121.jpg saved to cache
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d
2026-03-28 12:10:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c8001cd-8a76-5c14-8199-6303f5c9df6d, skipping ID generation
2026-03-28 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d with scrape type 1
2026-03-28 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c8001cd-8a76-5c14-8199-6303f5c9df6d sending to next pipeline
2026-03-28 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8c8001cd-8a76-5c14-8199-6303f5c9df6d, identifier: ME24209
2026-03-28 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-28 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164
2026-03-28 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe with identifier: JM32164 to the API
2026-03-28 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_b49fc48578b3aaf99c373be2591e24b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:43Z',
 'fuel_type': 'diesel',
 'id': '1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VH847V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM32164',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 178774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2601178,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_b49fc48578b3aaf99c373be2591e24b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_227fec376d53a01af868b275aafc90f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_0eba9397625175a88e9827f9c796a468.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_e051ad286fd3f36dcbedb903df96747d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482701,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_51a8949f36fd444e9b4194c372c0f55c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_67bac1689bcd157ba6b51f5d9f4c7027.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2299575,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_9fa1dd150916b44a949603e66cebcb7b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612649,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_65cc03aa716720273fd6148a97a2c3ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_6f49103a7bc64fe7eaa87acb1cb1b266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe/1db1f53b-a0f2-54d4-a2b0-bf0bcc709dbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/78/28785e3550d6888a9516f3445da18163/pa/JM32164_dc2a67d4d5d3f8fe2ec3b8abffc9aee4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-17',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2014}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM32164%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.nl] INFO: Saving data for JM32164: {'created_time': 1774699851.147475, 'last_price_update_time': 1774699851.147491, 'auction_closing_time': 1774885963.0}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM32164') HTTP/1.1" 204 0
2026-03-28 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-28 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800
2026-03-28 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d88977c0-4d35-544c-b133-257b8d5a731b with identifier: SE67800 to the API
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_4b89f5d5904db28780e033203e5b642b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:32Z',
 'fuel_type': 'petrol',
 'id': 'd88977c0-4d35-544c-b133-257b8d5a731b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '52TDJN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE67800',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 239178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_2260faa85105917c94be00d59e399158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_a6714dd7d32f9bd98edd6e45f5fc4fe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_4b89f5d5904db28780e033203e5b642b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_9593e9f633fb6643e7a94d8c4c312f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d88977c0-4d35-544c-b133-257b8d5a731b/d88977c0-4d35-544c-b133-257b8d5a731b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/f0/def06ad28fb530f7ae4b8705715f79bc/pa/SE67800_f89d5bf5d675400493a522c5f7b85c76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE67800%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.nl] INFO: Saving data for SE67800: {'created_time': 1774699851.500948, 'last_price_update_time': 1774699851.500959, 'auction_closing_time': 1774885832.0}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE67800') HTTP/1.1" 204 0
2026-03-28 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-28 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209
2026-03-28 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8c8001cd-8a76-5c14-8199-6303f5c9df6d with identifier: ME24209 to the API
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_18063db927cfe4ffa4cb282bbadff121.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:19:03Z',
 'fuel_type': 'petrol',
 'id': '8c8001cd-8a76-5c14-8199-6303f5c9df6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '41PPVZ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME24209',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 370484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_3ee3f5299693a4b6ab6397dc847cb2c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_18063db927cfe4ffa4cb282bbadff121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_de7d6327f1b5eb82e2ac5bb124023778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_1a1a7837fb770c8c499bb4b54a4a4b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c8001cd-8a76-5c14-8199-6303f5c9df6d/8c8001cd-8a76-5c14-8199-6303f5c9df6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/79/d679979f05adecf655ee991c5df08f9e/pa/ME24209_9ac379537c247c7f743d096d173f26a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-01',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME24209%27 HTTP/1.1" 200 None
2026-03-28 12:10:51 [auto1.nl] INFO: Saving data for ME24209: {'created_time': 1774699851.886586, 'last_price_update_time': 1774699851.886598, 'auction_closing_time': 1774883943.0}
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ME24209') HTTP/1.1" 204 0
2026-03-28 12:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WK03460> (referer: https://www.auto1.com/v1/car-details-view/WK03460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY33906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF57895/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd7d10>
2026-03-28 12:10:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a5db2e482bcdcc76944094d2e94e02%252Fpa%252FER86910_3221544202279b16f6da1a8bd8a96836.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_3221544202279b16f6da1a8bd8a96836.jpg saved to cache
2026-03-28 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58905a35-329b-5616-9c3b-d114610ed4c2
2026-03-28 12:10:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58905a35-329b-5616-9c3b-d114610ed4c2, skipping ID generation
2026-03-28 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58905a35-329b-5616-9c3b-d114610ed4c2 with scrape type 1
2026-03-28 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58905a35-329b-5616-9c3b-d114610ed4c2 sending to next pipeline
2026-03-28 12:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58905a35-329b-5616-9c3b-d114610ed4c2, identifier: ER86910
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN45594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-28 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910
2026-03-28 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58905a35-329b-5616-9c3b-d114610ed4c2 with identifier: ER86910 to the API
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_3221544202279b16f6da1a8bd8a96836.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:04Z',
 'fuel_type': 'petrol',
 'id': '58905a35-329b-5616-9c3b-d114610ed4c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KS828P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER86910',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 129299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_8d049757d5a3d23138bb4d98ec1ff4dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_3221544202279b16f6da1a8bd8a96836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_f16597fcb3bf366e65bac612891b5723.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_732b2fe5651ed518d98a4be3bb68ea11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710556,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_c9e517d6d8f1bea4b5f9bb59932a3c00.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_881d22e4bbfbc4f67286e4edaa1a605c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2584948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_a8baa8f0548ef9077bd21de726f04e98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_26956ac74eb217297ac4154435e249f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_88669fda7ed8e8841c806f17171d410b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58905a35-329b-5616-9c3b-d114610ed4c2/58905a35-329b-5616-9c3b-d114610ed4c2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a5db2e482bcdcc76944094d2e94e02/pa/ER86910_e134813f2bbb2df07599b924d779f421.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.2 Turbo Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER86910%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.nl] INFO: Saving data for ER86910: {'created_time': 1774699852.624793, 'last_price_update_time': 1774699852.624803, 'auction_closing_time': 1774884964.0}
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ER86910') HTTP/1.1" 204 0
2026-03-28 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-28 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 1
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg not downloaded yet
2026-03-28 12:10:52 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg not downloaded yet
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.nl] INFO: Scrape type for JW97628: 1
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_9ceee9565a0c8f916eb8affd9423103f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_0e2fbd5e031a183af78bdf1164250e76.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_0e2fbd5e031a183af78bdf1164250e76.jpg not downloaded yet
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.nl] INFO: Scrape type for LR40141: 1
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_2db87c4e99a053ac50d936fec7779222.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_bfd279ead31865475e53e11dec6e5385.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_124cf0d2c8090344c70324e3e2755ced.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_124cf0d2c8090344c70324e3e2755ced.jpg not downloaded yet
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.nl] INFO: Scrape type for EP93197: 1
2026-03-28 12:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK13348> (referer: https://www.auto1.com/v1/car-details-view/SK13348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg not downloaded yet
2026-03-28 12:10:52 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-28 12:10:52 [auto1.nl] INFO: Scrape type for DT42929: 2
2026-03-28 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-28 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d6700a-f12c-548c-997f-97f1bcf08383 with scrape type 2
2026-03-28 12:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 15d6700a-f12c-548c-997f-97f1bcf08383, identifier: DT42929
2026-03-28 12:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9b233af536c5471e19a3e71f99691e2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-28 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929
2026-03-28 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 15d6700a-f12c-548c-997f-97f1bcf08383 with identifier: DT42929 to the API
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:55:13Z',
 'fuel_type': 'diesel',
 'id': '15d6700a-f12c-548c-997f-97f1bcf08383',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT42929',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 237956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM 10 SX L1H1 130 Multijet',
 'transmission': 'manual',
 'trim': '10 SX L1H1 130 Multijet',
 'year': 2012}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT42929%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Saving data for DT42929: {'auction_closing_time': 1774886113.0, 'created_time': 1774033942.229374, 'last_price_update_time': 1774699853.263744}
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT42929') HTTP/1.1" 204 0
2026-03-28 12:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_a79166089904d4f20f40950d40bde01a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_231728cc6c2cba18a39611135260cdce.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_231728cc6c2cba18a39611135260cdce.jpg not downloaded yet
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV73218%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for AV73218: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC45761%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for VC45761: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT54062%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for CT54062: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL59810%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for GL59810: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG19961%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for PG19961: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM65316%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for MM65316: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-28 12:10:53 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR59954%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [auto1.nl] INFO: Scrape type for NR59954: 0
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_13dec59a79a377db5f6454e038c16a01.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394009d0>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_9ceee9565a0c8f916eb8affd9423103f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_9ceee9565a0c8f916eb8affd9423103f.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f21210>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_2db87c4e99a053ac50d936fec7779222.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_2db87c4e99a053ac50d936fec7779222.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913943fb10>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_bfd279ead31865475e53e11dec6e5385.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_bfd279ead31865475e53e11dec6e5385.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-28 12:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 1
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_cc2635e69588e346e2dbd342b952bb97.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_cc2635e69588e346e2dbd342b952bb97.jpg not downloaded yet
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_e273a441263c2620465de4c9caf9167c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg not downloaded yet
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393d4e10>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_9b233af536c5471e19a3e71f99691e2c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9b233af536c5471e19a3e71f99691e2c.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a17a150>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_a79166089904d4f20f40950d40bde01a.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_a79166089904d4f20f40950d40bde01a.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_8c53382c674816ac65a7bf2198678b5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8c53382c674816ac65a7bf2198678b5d.jpg not downloaded yet
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395f4750>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_13dec59a79a377db5f6454e038c16a01.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_13dec59a79a377db5f6454e038c16a01.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f3b1d0>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_e273a441263c2620465de4c9caf9167c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_e273a441263c2620465de4c9caf9167c.jpg saved to cache
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg not downloaded yet
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_6bcb02a24077d818211c7bd7b000d67c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg not downloaded yet
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg not downloaded yet
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_d0e794be90b0b3773450fedd357ecb16.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_d0e794be90b0b3773450fedd357ecb16.jpg not downloaded yet
2026-03-28 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139435e90>
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg not downloaded yet
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_9941e6e84723249a6331d7b70d2927b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_9941e6e84723249a6331d7b70d2927b2.jpg not downloaded yet
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg not downloaded yet
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393dc450>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_6bcb02a24077d818211c7bd7b000d67c.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_6bcb02a24077d818211c7bd7b000d67c.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7a738543688100263f02bcc5db9a7461.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_124cf0d2c8090344c70324e3e2755ced.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9149bb9e90>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961b710>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd2190>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_7a738543688100263f02bcc5db9a7461.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7a738543688100263f02bcc5db9a7461.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139eed390>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139eed050>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_124cf0d2c8090344c70324e3e2755ced.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_124cf0d2c8090344c70324e3e2755ced.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_0e2fbd5e031a183af78bdf1164250e76.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8c53382c674816ac65a7bf2198678b5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393c6ad0>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5780f7a165502679235b02ad45a412d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR40141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_cc2635e69588e346e2dbd342b952bb97.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW97628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913943fa90>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_0e2fbd5e031a183af78bdf1164250e76.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_0e2fbd5e031a183af78bdf1164250e76.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393d5d50>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139601d50>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_8c53382c674816ac65a7bf2198678b5d.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8c53382c674816ac65a7bf2198678b5d.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_d0e794be90b0b3773450fedd357ecb16.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP93197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913957d910>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951f590>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_5780f7a165502679235b02ad45a412d1.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5780f7a165502679235b02ad45a412d1.jpg saved to cache
2026-03-28 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394de2d0>
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f07a90>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_cc2635e69588e346e2dbd342b952bb97.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_cc2635e69588e346e2dbd342b952bb97.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395118d0>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_9941e6e84723249a6331d7b70d2927b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_231728cc6c2cba18a39611135260cdce.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961c790>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_d0e794be90b0b3773450fedd357ecb16.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_d0e794be90b0b3773450fedd357ecb16.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139416ed0>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d6bd0>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_9941e6e84723249a6331d7b70d2927b2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_9941e6e84723249a6331d7b70d2927b2.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a06f310>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_231728cc6c2cba18a39611135260cdce.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_231728cc6c2cba18a39611135260cdce.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913967d790>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393f4f50>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a05f610>
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252F5c%252Fd45c9c13d82c2f7c9ab77dae83c07661%252Fpa%252FSK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg saved to cache
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a4be411-cd89-5d76-bf40-b04fee70a927
2026-03-28 12:10:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a4be411-cd89-5d76-bf40-b04fee70a927, skipping ID generation
2026-03-28 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4be411-cd89-5d76-bf40-b04fee70a927 with scrape type 1
2026-03-28 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a4be411-cd89-5d76-bf40-b04fee70a927 sending to next pipeline
2026-03-28 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3a4be411-cd89-5d76-bf40-b04fee70a927, identifier: SK13348
2026-03-28 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_3d177dc277aeba73c4635fb8b3567d19.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-28 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348
2026-03-28 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3a4be411-cd89-5d76-bf40-b04fee70a927 with identifier: SK13348 to the API
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:06:11Z',
 'fuel_type': 'petrol',
 'id': '3a4be411-cd89-5d76-bf40-b04fee70a927',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '62NZGB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK13348',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_cc2635e69588e346e2dbd342b952bb97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_51a6645d2edab3de2c9d9fce20f332a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8c53382c674816ac65a7bf2198678b5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2095244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_fe7c7d5ad34ed0ab518a3b8fec5c7254.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4fa05ab8c89b755dc7d64aed88fae9ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708903,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_8632cb86c832f7fccd9e936aa3cbfb0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_d0e794be90b0b3773450fedd357ecb16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_4301b9d7821f19624709ef5ef17bc3f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_9941e6e84723249a6331d7b70d2927b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4be411-cd89-5d76-bf40-b04fee70a927/3a4be411-cd89-5d76-bf40-b04fee70a927_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/5c/d45c9c13d82c2f7c9ab77dae83c07661/pa/SK13348_093f99ab476ab7e73a903b38e1d4f5f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318i Edition Exclusive',
 'transmission': 'automatic',
 'trim': 'Edition Exclusive',
 'year': 2004}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SK13348%27 HTTP/1.1" 200 None
2026-03-28 12:10:56 [auto1.nl] INFO: Saving data for SK13348: {'created_time': 1774699856.575664, 'last_price_update_time': 1774699856.575673, 'auction_closing_time': 1774883171.0}
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SK13348') HTTP/1.1" 204 0
2026-03-28 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_4f70902ee836c1582effc0ba3f0b596f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_63971793d1282083a8a4ca12ddc46c99.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN45594> (referer: https://www.auto1.com/v1/car-details-view/TN45594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139544a10>
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fcd%252F75cdc98022077033d09930d53398c49d%252Fpa%252FWK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg saved to cache
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4384629a-9755-541c-83b9-7bc1cdb64060
2026-03-28 12:10:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4384629a-9755-541c-83b9-7bc1cdb64060, skipping ID generation
2026-03-28 12:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4384629a-9755-541c-83b9-7bc1cdb64060 with scrape type 1
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4384629a-9755-541c-83b9-7bc1cdb64060 sending to next pipeline
2026-03-28 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4384629a-9755-541c-83b9-7bc1cdb64060, identifier: WK03460
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139510410>
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg saved to cache
2026-03-28 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139425890>
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1eaad0>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_3d177dc277aeba73c4635fb8b3567d19.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_3d177dc277aeba73c4635fb8b3567d19.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-28 12:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460
2026-03-28 12:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4384629a-9755-541c-83b9-7bc1cdb64060 with identifier: WK03460 to the API
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:32Z',
 'fuel_type': 'petrol',
 'id': '4384629a-9755-541c-83b9-7bc1cdb64060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '07shbp',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK03460',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 285326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_d079e655c2ba2f064f20ddc0ea622c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_58f5541fb6c2631493d2b053f9e7fd0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_0e2fbd5e031a183af78bdf1164250e76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_124cf0d2c8090344c70324e3e2755ced.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_c76ca78f0a77e332ee8cd54543c59bfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4384629a-9755-541c-83b9-7bc1cdb64060/4384629a-9755-541c-83b9-7bc1cdb64060_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/cd/75cdc98022077033d09930d53398c49d/pa/WK03460_231728cc6c2cba18a39611135260cdce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK03460%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [auto1.nl] INFO: Saving data for WK03460: {'created_time': 1774699857.430934, 'last_price_update_time': 1774699857.430943, 'auction_closing_time': 1774884212.0}
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK03460') HTTP/1.1" 204 0
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY33906> (referer: https://www.auto1.com/v1/car-details-view/WY33906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF57895> (referer: https://www.auto1.com/v1/car-details-view/PF57895/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW97628> (referer: https://www.auto1.com/v1/car-details-view/JW97628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5c73f32076f9105bb0542ff6de735474.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4627eab9c6518795ebcb0cda595ae238.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_708a8c527d52979fcc44657a48cdaefe.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913960c750>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_4f70902ee836c1582effc0ba3f0b596f.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_4f70902ee836c1582effc0ba3f0b596f.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a1539d0>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_63971793d1282083a8a4ca12ddc46c99.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_63971793d1282083a8a4ca12ddc46c99.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 1
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg not downloaded yet
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg not downloaded yet
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 1
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_a8c94d6e904bafc3bb46d134929627c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a8c94d6e904bafc3bb46d134929627c2.jpg not downloaded yet
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 1
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg not downloaded yet
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 1
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_315412762fb1bac6834b120e09001cc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_315412762fb1bac6834b120e09001cc0.jpg not downloaded yet
2026-03-28 12:10:57 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1045 | hits on page: 40
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393ed1d0>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_5c73f32076f9105bb0542ff6de735474.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5c73f32076f9105bb0542ff6de735474.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395c8050>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a068b90>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F61%252Fb661080fba565a4ee64b7d32fbf4699f%252Fpa%252FXK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg saved to cache
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed0e3456-123f-53b7-b2e4-203eec5b124b
2026-03-28 12:10:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed0e3456-123f-53b7-b2e4-203eec5b124b, skipping ID generation
2026-03-28 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0e3456-123f-53b7-b2e4-203eec5b124b with scrape type 1
2026-03-28 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed0e3456-123f-53b7-b2e4-203eec5b124b sending to next pipeline
2026-03-28 12:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed0e3456-123f-53b7-b2e4-203eec5b124b, identifier: XK28167
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394c9a50>
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe6%252F75e60b9aae78e578606f817ec539a45f%252Fpa%252FAX92237_4627eab9c6518795ebcb0cda595ae238.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4627eab9c6518795ebcb0cda595ae238.jpg saved to cache
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047
2026-03-28 12:10:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047, skipping ID generation
2026-03-28 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with scrape type 1
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 sending to next pipeline
2026-03-28 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047, identifier: AX92237
2026-03-28 12:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394404d0>
2026-03-28 12:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F80%252Fa980ecc3e9acc77bfcb52f747a24cf12%252Fpa%252FPH88105_708a8c527d52979fcc44657a48cdaefe.jpg') HTTP/1.1" 204 0
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_708a8c527d52979fcc44657a48cdaefe.jpg saved to cache
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f6b085d-7443-5b82-9770-1cfd82694c34
2026-03-28 12:10:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f6b085d-7443-5b82-9770-1cfd82694c34, skipping ID generation
2026-03-28 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6b085d-7443-5b82-9770-1cfd82694c34 with scrape type 1
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f6b085d-7443-5b82-9770-1cfd82694c34 sending to next pipeline
2026-03-28 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0f6b085d-7443-5b82-9770-1cfd82694c34, identifier: PH88105
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg not downloaded yet
2026-03-28 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-28 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167
2026-03-28 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed0e3456-123f-53b7-b2e4-203eec5b124b with identifier: XK28167 to the API
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': 'ed0e3456-123f-53b7-b2e4-203eec5b124b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '77hdv5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK28167',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Volvo',
 'model': 'S80',
 'odometer': 322705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d866c3bd3b8b8bc7a336851d6c32dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_ad1f8a0c76aaa4921e3e1663d39dae2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_3a50e5a739b15c9901cd7eec81dceeac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_13dec59a79a377db5f6454e038c16a01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0e3456-123f-53b7-b2e4-203eec5b124b/ed0e3456-123f-53b7-b2e4-203eec5b124b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/61/b661080fba565a4ee64b7d32fbf4699f/pa/XK28167_57d916536c844fd41f9c726064f8aa53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo S80 2.5 TF Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK28167%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.nl] INFO: Saving data for XK28167: {'created_time': 1774699858.628594, 'last_price_update_time': 1774699858.628608, 'auction_closing_time': 1774885690.0}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XK28167') HTTP/1.1" 204 0
2026-03-28 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-28 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237
2026-03-28 12:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9fdb8bb0-d0e2-56db-8ee1-34905a27a047 with identifier: AX92237 to the API
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4627eab9c6518795ebcb0cda595ae238.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'petrol',
 'id': '9fdb8bb0-d0e2-56db-8ee1-34905a27a047',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HS091L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX92237',
 'listing': 'auction',
 'location': 'NL, Maastricht',
 'make': 'Mazda',
 'model': '2',
 'odometer': 157242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4627eab9c6518795ebcb0cda595ae238.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_1e491dcf6c2a6d10b06d2da1910d1711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_3e88ddc429fc7ef52fdd65e07900af26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_9ceee9565a0c8f916eb8affd9423103f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fdb8bb0-d0e2-56db-8ee1-34905a27a047/9fdb8bb0-d0e2-56db-8ee1-34905a27a047_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e6/75e60b9aae78e578606f817ec539a45f/pa/AX92237_4a0ea8a126d398007d0ed954627326f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.3 Edition 40 Jahre',
 'transmission': 'manual',
 'trim': 'Edition 40 Jahre',
 'year': 2012}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX92237%27 HTTP/1.1" 200 None
2026-03-28 12:10:58 [auto1.nl] INFO: Saving data for AX92237: {'created_time': 1774699858.979291, 'last_price_update_time': 1774699858.979302, 'auction_closing_time': 1774886125.0}
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX92237') HTTP/1.1" 204 0
2026-03-28 12:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-28 12:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105
2026-03-28 12:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0f6b085d-7443-5b82-9770-1cfd82694c34 with identifier: PH88105 to the API
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_708a8c527d52979fcc44657a48cdaefe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:29:39Z',
 'fuel_type': 'petrol',
 'id': '0f6b085d-7443-5b82-9770-1cfd82694c34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P412RD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH88105',
 'listing': 'auction',
 'location': 'NL, Vianen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 204758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_708a8c527d52979fcc44657a48cdaefe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_ddd35e8e9ee6435d1ed024835a4facb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_6bcb02a24077d818211c7bd7b000d67c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_bfd279ead31865475e53e11dec6e5385.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_dfd46bf8ed8f9bdfc2b34351bc83f4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_2db87c4e99a053ac50d936fec7779222.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_1d17cdf2b36a32b5187027ff837f11b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_9fd3cd1f217c4848b7ebebee0e848291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_e09d5433af20e0a4fd3e3e2506c102a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f6b085d-7443-5b82-9770-1cfd82694c34/0f6b085d-7443-5b82-9770-1cfd82694c34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/80/a980ecc3e9acc77bfcb52f747a24cf12/pa/PH88105_53f37610a3c3b57f7d9670717d2b8b3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH88105%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Saving data for PH88105: {'created_time': 1774699859.368363, 'last_price_update_time': 1774699859.368372, 'auction_closing_time': 1774884579.0}
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH88105') HTTP/1.1" 204 0
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_c951cdc0eef8322afd5999b873684b55.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_4233f8fdfc80938befdb3f31802a5077.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4233f8fdfc80938befdb3f31802a5077.jpg not downloaded yet
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_0215a50adf55d9d506cd79722cf60651.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_0215a50adf55d9d506cd79722cf60651.jpg not downloaded yet
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg not downloaded yet
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH14183%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for EH14183: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD03329%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for VD03329: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WX34396%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for WX34396: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ01481%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for PZ01481: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for RF40574: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA80905%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for AA80905: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02577%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for WF02577: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU99712%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for TU99712: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA23366%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for RA23366: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB80121%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for UB80121: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG71332%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for LG71332: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM47469%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for JM47469: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX66014%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for BX66014: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME20407%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for ME20407: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR40415%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for SR40415: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ48021%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for MZ48021: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH01672%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for VH01672: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH34143%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for FH34143: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for YP25238: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for HS95271: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for PJ78328: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for MW65068: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for KB97698: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for UC91516: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for LU39943: 0
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 12:10:59 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [auto1.nl] INFO: Scrape type for CV76653: 0
2026-03-28 12:10:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_2439c9cb756cded612e6029fa30a2035.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_cb965752344fa3dbba779987773b33d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_331e6d8976e4a1287804b9ce87269c62.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg not downloaded yet
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR40141> (referer: https://www.auto1.com/v1/car-details-view/LR40141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP93197> (referer: https://www.auto1.com/v1/car-details-view/EP93197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg not downloaded yet
2026-03-28 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_ebb10c689fa91adfbd98614c329e9f20.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_ebb10c689fa91adfbd98614c329e9f20.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_028163e2399c29c474458ec69cbf49db.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_028163e2399c29c474458ec69cbf49db.jpg not downloaded yet
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951a150>
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_c951cdc0eef8322afd5999b873684b55.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_c951cdc0eef8322afd5999b873684b55.jpg saved to cache
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg not downloaded yet
2026-03-28 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_aaa8105bc1e8729f6219692b9e700a73.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_aaa8105bc1e8729f6219692b9e700a73.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_9b56841893a579490a7c64b8b010ad00.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_9b56841893a579490a7c64b8b010ad00.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg not downloaded yet
2026-03-28 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_1dd6157547faf847bc07c6ba6adbe033.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_1dd6157547faf847bc07c6ba6adbe033.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_a6183ba09111652ab298d30240223fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a6183ba09111652ab298d30240223fa6.jpg not downloaded yet
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_8f239f2600151797b7dd795e8a4836bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_8f239f2600151797b7dd795e8a4836bf.jpg not downloaded yet
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139507e50>
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_2439c9cb756cded612e6029fa30a2035.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_2439c9cb756cded612e6029fa30a2035.jpg saved to cache
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139eebdd0>
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_cb965752344fa3dbba779987773b33d6.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_cb965752344fa3dbba779987773b33d6.jpg saved to cache
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a17a1d0>
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_331e6d8976e4a1287804b9ce87269c62.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_331e6d8976e4a1287804b9ce87269c62.jpg saved to cache
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-28 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1209bd14-ac06-5df4-9618-dcc22a134f1f with scrape type 1
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1209bd14-ac06-5df4-9618-dcc22a134f1f
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_6a96259d01850d21947b88640d1ab22e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_6a96259d01850d21947b88640d1ab22e.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_35bf55549c90b219087c5d8a3a7a01dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_35bf55549c90b219087c5d8a3a7a01dc.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_f87d3c6b8c75b092735be31d8d37c80c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f87d3c6b8c75b092735be31d8d37c80c.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_82900bfa7f671c52f2c11d93b5fc8355.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_82900bfa7f671c52f2c11d93b5fc8355.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_f3233cfa49d0859b7413dbf986c917bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f3233cfa49d0859b7413dbf986c917bb.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_f66fee62ce435a4912101232e1ef3f4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f66fee62ce435a4912101232e1ef3f4d.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_60bcb84f295981922ffdc750fca0e7d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_60bcb84f295981922ffdc750fca0e7d1.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_116bdc458711c54007d69d975d70cb2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_116bdc458711c54007d69d975d70cb2d.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_9ce3aa2a4bd5fa81492706aa50d423b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_9ce3aa2a4bd5fa81492706aa50d423b7.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Fe5%252F41e57fb4e1446c4e3f994a4e1afc4e49%252Fpa%252FLR40141_529bd55c2eec7e6aa71b2012cd689ec7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_529bd55c2eec7e6aa71b2012cd689ec7.jpg already downloaded
2026-03-28 12:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1209bd14-ac06-5df4-9618-dcc22a134f1f, identifier: LR40141
2026-03-28 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-28 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with scrape type 1
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c4f38ad-0cf0-5e8d-a429-4516e62c5072
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_87c11c0586e7b22870447dc50e91c174.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_87c11c0586e7b22870447dc50e91c174.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_8d1261c72ee613148b0cfd8d3f1b770d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8d1261c72ee613148b0cfd8d3f1b770d.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_4c9dd2cdd68bc621ec22d981696bcf9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_4c9dd2cdd68bc621ec22d981696bcf9f.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_85f5933053ff37b4b02cd0152c9873d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_85f5933053ff37b4b02cd0152c9873d2.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_59b4ecf37d047ad71cb469d00f82bc5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_59b4ecf37d047ad71cb469d00f82bc5e.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_e8ad304270a023642296351819a4f07c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e8ad304270a023642296351819a4f07c.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_399cb1ca6c8e67258030be7bc8c3713c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_399cb1ca6c8e67258030be7bc8c3713c.jpg already downloaded
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_e70daa40932bafa55ae64b4464c6eb32.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e70daa40932bafa55ae64b4464c6eb32.jpg already downloaded
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_cb9441001c4fbd575197dd1b08f0b099.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_cb9441001c4fbd575197dd1b08f0b099.jpg already downloaded
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F0b%252F150bb49da37eae2d6eadfcb5161640a0%252Fpa%252FEP93197_8f8d4c590fec42a610ad3f3ab098b5f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8f8d4c590fec42a610ad3f3ab098b5f6.jpg already downloaded
2026-03-28 12:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072, identifier: EP93197
2026-03-28 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_315412762fb1bac6834b120e09001cc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_53ddcd623a65eb02189426d66410e9cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_53ddcd623a65eb02189426d66410e9cf.jpg not downloaded yet
2026-03-28 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-28 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141
2026-03-28 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1209bd14-ac06-5df4-9618-dcc22a134f1f with identifier: LR40141 to the API
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LR40141>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:00Z',
 'fuel_type': 'petrol',
 'id': '1209bd14-ac06-5df4-9618-dcc22a134f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RH171K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR40141',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 139943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_6a96259d01850d21947b88640d1ab22e.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_35bf55549c90b219087c5d8a3a7a01dc.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f87d3c6b8c75b092735be31d8d37c80c.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_82900bfa7f671c52f2c11d93b5fc8355.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f3233cfa49d0859b7413dbf986c917bb.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f66fee62ce435a4912101232e1ef3f4d.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_60bcb84f295981922ffdc750fca0e7d1.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_116bdc458711c54007d69d975d70cb2d.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_9ce3aa2a4bd5fa81492706aa50d423b7.jpg',
                'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_529bd55c2eec7e6aa71b2012cd689ec7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_6a96259d01850d21947b88640d1ab22e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2818115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_35bf55549c90b219087c5d8a3a7a01dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2033986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f87d3c6b8c75b092735be31d8d37c80c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2054225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_82900bfa7f671c52f2c11d93b5fc8355.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f3233cfa49d0859b7413dbf986c917bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2028307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_f66fee62ce435a4912101232e1ef3f4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2103916,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_60bcb84f295981922ffdc750fca0e7d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_116bdc458711c54007d69d975d70cb2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2694479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_9ce3aa2a4bd5fa81492706aa50d423b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1209bd14-ac06-5df4-9618-dcc22a134f1f/1209bd14-ac06-5df4-9618-dcc22a134f1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2322163,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/e5/41e57fb4e1446c4e3f994a4e1afc4e49/pa/LR40141_529bd55c2eec7e6aa71b2012cd689ec7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR40141%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.nl] INFO: Saving data for LR40141: {'created_time': 1774699861.487774, 'last_price_update_time': 1774699861.487788, 'auction_closing_time': 1774885800.0}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR40141') HTTP/1.1" 204 0
2026-03-28 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-28 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197
2026-03-28 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c4f38ad-0cf0-5e8d-a429-4516e62c5072 with identifier: EP93197 to the API
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EP93197>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:16Z',
 'fuel_type': 'petrol',
 'id': '7c4f38ad-0cf0-5e8d-a429-4516e62c5072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H348PD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP93197',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 203514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_87c11c0586e7b22870447dc50e91c174.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8d1261c72ee613148b0cfd8d3f1b770d.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_4c9dd2cdd68bc621ec22d981696bcf9f.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_85f5933053ff37b4b02cd0152c9873d2.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_59b4ecf37d047ad71cb469d00f82bc5e.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e8ad304270a023642296351819a4f07c.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_399cb1ca6c8e67258030be7bc8c3713c.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e70daa40932bafa55ae64b4464c6eb32.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_cb9441001c4fbd575197dd1b08f0b099.jpg',
                'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8f8d4c590fec42a610ad3f3ab098b5f6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_87c11c0586e7b22870447dc50e91c174.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2111748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8d1261c72ee613148b0cfd8d3f1b770d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2145604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_4c9dd2cdd68bc621ec22d981696bcf9f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156312,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_85f5933053ff37b4b02cd0152c9873d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1945977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_59b4ecf37d047ad71cb469d00f82bc5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e8ad304270a023642296351819a4f07c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_399cb1ca6c8e67258030be7bc8c3713c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2063759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_e70daa40932bafa55ae64b4464c6eb32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2275149,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_cb9441001c4fbd575197dd1b08f0b099.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c4f38ad-0cf0-5e8d-a429-4516e62c5072/7c4f38ad-0cf0-5e8d-a429-4516e62c5072_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/0b/150bb49da37eae2d6eadfcb5161640a0/pa/EP93197_8f8d4c590fec42a610ad3f3ab098b5f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2020}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP93197%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [auto1.nl] INFO: Saving data for EP93197: {'created_time': 1774699861.917669, 'last_price_update_time': 1774699861.917679, 'auction_closing_time': 1774884616.0}
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EP93197') HTTP/1.1" 204 0
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg not downloaded yet
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_b529b37244d9a6e70aea95f4eed3862c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_b529b37244d9a6e70aea95f4eed3862c.jpg not downloaded yet
2026-03-28 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE83954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG85677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395d9c90>
2026-03-28 12:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913960bf90>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F99%252Ffa9946918694abd3989f13d970f3f63d%252Fpa%252FJC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 295ae144-6ea5-53ed-81d6-2d72c0a23940
2026-03-28 12:11:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 295ae144-6ea5-53ed-81d6-2d72c0a23940, skipping ID generation
2026-03-28 12:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 with scrape type 1
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 295ae144-6ea5-53ed-81d6-2d72c0a23940 sending to next pipeline
2026-03-28 12:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 295ae144-6ea5-53ed-81d6-2d72c0a23940, identifier: JC30911
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg not downloaded yet
2026-03-28 12:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-28 12:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911
2026-03-28 12:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 295ae144-6ea5-53ed-81d6-2d72c0a23940 with identifier: JC30911 to the API
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:56Z',
 'fuel_type': 'petrol',
 'id': '295ae144-6ea5-53ed-81d6-2d72c0a23940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '51lrpd',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC30911',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 117943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b025cb9d6f3a7c17f285dc3951a32649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_f66e873181183b31fc9b4c2e0ab5ca63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_b421eba71b0ade8ab5591f0fb682b3e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_543ced3665caafc6a5cf4bb4b1c50622.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_23b10f9ae66042dd2086aa8a2ec77cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_295ae144-6ea5-53ed-81d6-2d72c0a23940/295ae144-6ea5-53ed-81d6-2d72c0a23940_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/99/fa9946918694abd3989f13d970f3f63d/pa/JC30911_c951cdc0eef8322afd5999b873684b55.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC',
 'transmission': 'automatic',
 'trim': 'CC',
 'year': 2003}
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC30911%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [auto1.nl] INFO: Saving data for JC30911: {'created_time': 1774699862.606207, 'last_price_update_time': 1774699862.606219, 'auction_closing_time': 1774885736.0}
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JC30911') HTTP/1.1" 204 0
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_145c3d2153de5b19f9675832c9e9960b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_145c3d2153de5b19f9675832c9e9960b.jpg not downloaded yet
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX97177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg not downloaded yet
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b9350>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394a79d0>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_315412762fb1bac6834b120e09001cc0.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_315412762fb1bac6834b120e09001cc0.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913960f210>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913946f790>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_0215a50adf55d9d506cd79722cf60651.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_028163e2399c29c474458ec69cbf49db.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b19d0>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_4b40288788d26d6f424a74ddd338ade7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_8162437efa056254cbce2a3480a1f6d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_8f239f2600151797b7dd795e8a4836bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_17061ca797909aca5260599080b2b4c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a6183ba09111652ab298d30240223fa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91396164d0>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_0215a50adf55d9d506cd79722cf60651.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_0215a50adf55d9d506cd79722cf60651.jpg saved to cache
2026-03-28 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139423690>
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139426050>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_028163e2399c29c474458ec69cbf49db.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_028163e2399c29c474458ec69cbf49db.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_9b56841893a579490a7c64b8b010ad00.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_145c3d2153de5b19f9675832c9e9960b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_1dd6157547faf847bc07c6ba6adbe033.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_b529b37244d9a6e70aea95f4eed3862c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b76d0>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F39%252F0a395db4b11068f5a388dcfd61c5dcd5%252Fpa%252FEH33258_4b40288788d26d6f424a74ddd338ade7.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_4b40288788d26d6f424a74ddd338ade7.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6d91734-2904-5060-9ee7-bf5d724f6b35
2026-03-28 12:11:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6d91734-2904-5060-9ee7-bf5d724f6b35, skipping ID generation
2026-03-28 12:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d91734-2904-5060-9ee7-bf5d724f6b35 with scrape type 1
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6d91734-2904-5060-9ee7-bf5d724f6b35 sending to next pipeline
2026-03-28 12:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6d91734-2904-5060-9ee7-bf5d724f6b35, identifier: EH33258
2026-03-28 12:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393c5b50>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fc5%252Fc2c53b9dea14f0b78d9a49aa66f06e6b%252Fpa%252FUF12505_8162437efa056254cbce2a3480a1f6d5.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_8162437efa056254cbce2a3480a1f6d5.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4984b984-35a6-57e2-bee5-74b747984935
2026-03-28 12:11:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4984b984-35a6-57e2-bee5-74b747984935, skipping ID generation
2026-03-28 12:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4984b984-35a6-57e2-bee5-74b747984935 with scrape type 1
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4984b984-35a6-57e2-bee5-74b747984935 sending to next pipeline
2026-03-28 12:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4984b984-35a6-57e2-bee5-74b747984935, identifier: UF12505
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139688b10>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_8f239f2600151797b7dd795e8a4836bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_8f239f2600151797b7dd795e8a4836bf.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b3290>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139611e10>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252Fd4%252Fe2d49b71cacb05abba2105d8555110b7%252Fpa%252FWG90560_17061ca797909aca5260599080b2b4c0.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_17061ca797909aca5260599080b2b4c0.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 444c48c3-3381-5989-ab41-910b8b367ec3
2026-03-28 12:11:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 444c48c3-3381-5989-ab41-910b8b367ec3, skipping ID generation
2026-03-28 12:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444c48c3-3381-5989-ab41-910b8b367ec3 with scrape type 1
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 444c48c3-3381-5989-ab41-910b8b367ec3 sending to next pipeline
2026-03-28 12:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444c48c3-3381-5989-ab41-910b8b367ec3, identifier: WG90560
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913953a890>
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_a6183ba09111652ab298d30240223fa6.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a6183ba09111652ab298d30240223fa6.jpg saved to cache
2026-03-28 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-28 12:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258
2026-03-28 12:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6d91734-2904-5060-9ee7-bf5d724f6b35 with identifier: EH33258 to the API
2026-03-28 12:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_4b40288788d26d6f424a74ddd338ade7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 289,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.2L',
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:07:10Z',
 'fuel_type': 'petrol',
 'id': 'd6d91734-2904-5060-9ee7-bf5d724f6b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '97GDT2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH33258',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 332576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_2932c2ec2c1918f344c1a2b44febafd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2664435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_4b40288788d26d6f424a74ddd338ade7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_3d177dc277aeba73c4635fb8b3567d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2400678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cd5a6b24dcc7fef62fb73476208ce76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_cc75010b6af96b0449ef18bddb25a861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_a79166089904d4f20f40950d40bde01a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_9cb26f988a05606650f1f50ab0dfac27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_c519442d067bcff974750e4a7794211c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2311971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_0fd49bb6b3fbc4986828c93cd18a092a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6d91734-2904-5060-9ee7-bf5d724f6b35/d6d91734-2904-5060-9ee7-bf5d724f6b35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700827,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/39/0a395db4b11068f5a388dcfd61c5dcd5/pa/EH33258_63b7ba4f33938911d4f741f28656d20f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 3.2 Sport Geartronic',
 'transmission': 'automatic',
 'trim': 'Sport Geartronic',
 'year': 2008}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH33258%27 HTTP/1.1" 200 None
2026-03-28 12:11:04 [auto1.nl] INFO: Saving data for EH33258: {'created_time': 1774699864.23693, 'last_price_update_time': 1774699864.23697, 'auction_closing_time': 1774883230.0}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH33258') HTTP/1.1" 204 0
2026-03-28 12:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-28 12:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505
2026-03-28 12:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4984b984-35a6-57e2-bee5-74b747984935 with identifier: UF12505 to the API
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_8162437efa056254cbce2a3480a1f6d5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:50:59Z',
 'fuel_type': 'petrol',
 'id': '4984b984-35a6-57e2-bee5-74b747984935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4ZJD28',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF12505',
 'listing': 'auction',
 'location': 'NL, Apeldoorn',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 202222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5c73f32076f9105bb0542ff6de735474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2583835,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_8162437efa056254cbce2a3480a1f6d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_4f70902ee836c1582effc0ba3f0b596f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2372353,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_02b75dc06bc67ef54bc12e63c8ba72e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_ccf4a2b550fbb1153f60c28fa76cbb4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2604088,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_5780f7a165502679235b02ad45a412d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7ae481cfe4d81c941e70bc8838b1f882.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_7a738543688100263f02bcc5db9a7461.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_d961e1416773829e2cc3d5a69a30308c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4984b984-35a6-57e2-bee5-74b747984935/4984b984-35a6-57e2-bee5-74b747984935_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/c5/c2c53b9dea14f0b78d9a49aa66f06e6b/pa/UF12505_9be442b7eaa1806e12362c91d1dca6d3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Feline',
 'transmission': 'automatic',
 'trim': 'Feline',
 'year': 2015}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF12505%27 HTTP/1.1" 200 None
2026-03-28 12:11:04 [auto1.nl] INFO: Saving data for UF12505: {'created_time': 1774699864.620212, 'last_price_update_time': 1774699864.620222, 'auction_closing_time': 1774885859.0}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF12505') HTTP/1.1" 204 0
2026-03-28 12:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-28 12:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560
2026-03-28 12:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444c48c3-3381-5989-ab41-910b8b367ec3 with identifier: WG90560 to the API
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_17061ca797909aca5260599080b2b4c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': '444c48c3-3381-5989-ab41-910b8b367ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JJ384N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG90560',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 94859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_17061ca797909aca5260599080b2b4c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_cb965752344fa3dbba779987773b33d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_331e6d8976e4a1287804b9ce87269c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_2439c9cb756cded612e6029fa30a2035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2280946,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_a5e4a9f88eeb94b0dc6d160f6d9fb223.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_63971793d1282083a8a4ca12ddc46c99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_e273a441263c2620465de4c9caf9167c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9b233af536c5471e19a3e71f99691e2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_5500a6ffc46a3549a8237e1eaa443d3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_444c48c3-3381-5989-ab41-910b8b367ec3/444c48c3-3381-5989-ab41-910b8b367ec3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414411,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/d4/e2d49b71cacb05abba2105d8555110b7/pa/WG90560_9bdb113c9a4acf1c464cfec32b17916f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2016}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG90560%27 HTTP/1.1" 200 None
2026-03-28 12:11:04 [auto1.nl] INFO: Saving data for WG90560: {'created_time': 1774699864.982412, 'last_price_update_time': 1774699864.982424, 'auction_closing_time': 1774884426.0}
2026-03-28 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG90560') HTTP/1.1" 204 0
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_aaa8105bc1e8729f6219692b9e700a73.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b17d0>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_9b56841893a579490a7c64b8b010ad00.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_9b56841893a579490a7c64b8b010ad00.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a04a0d0>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_145c3d2153de5b19f9675832c9e9960b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_145c3d2153de5b19f9675832c9e9960b.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913941f2d0>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:05 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a16e6d0>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_1dd6157547faf847bc07c6ba6adbe033.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_1dd6157547faf847bc07c6ba6adbe033.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913953ba10>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a16d790>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_b529b37244d9a6e70aea95f4eed3862c.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_b529b37244d9a6e70aea95f4eed3862c.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for CZ60443: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for AB54016: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for FJ00169: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for WT58034: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for YM03723: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for TR64287: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for LE34975: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for FK53895: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for JX13279: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for NT56594: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for FU47491: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for NL54745: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for AS22669: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for BM26306: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for HS94001: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for BL56682: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-28 12:11:05 [auto1.nl] INFO: Scrape type for MB63862: 0
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 12:11:05 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fe1d10>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a15cd50>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_aaa8105bc1e8729f6219692b9e700a73.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_aaa8105bc1e8729f6219692b9e700a73.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_53ddcd623a65eb02189426d66410e9cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_ebb10c689fa91adfbd98614c329e9f20.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a8c94d6e904bafc3bb46d134929627c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a15f610>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_53ddcd623a65eb02189426d66410e9cf.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_53ddcd623a65eb02189426d66410e9cf.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX97177> (referer: https://www.auto1.com/v1/car-details-view/SX97177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393a76d0>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg saved to cache
2026-03-28 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139551390>
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fed%252Ff7edd0596396935ed70b82d16156253a%252Fpa%252FPF57895_ebb10c689fa91adfbd98614c329e9f20.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_ebb10c689fa91adfbd98614c329e9f20.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item facf7e4a-cc13-5a68-a60c-79ce99195938
2026-03-28 12:11:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: facf7e4a-cc13-5a68-a60c-79ce99195938, skipping ID generation
2026-03-28 12:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item facf7e4a-cc13-5a68-a60c-79ce99195938 with scrape type 1
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item facf7e4a-cc13-5a68-a60c-79ce99195938 sending to next pipeline
2026-03-28 12:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: facf7e4a-cc13-5a68-a60c-79ce99195938, identifier: PF57895
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395870d0>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a067a90>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_a8c94d6e904bafc3bb46d134929627c2.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a8c94d6e904bafc3bb46d134929627c2.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913957f950>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b6390>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4233f8fdfc80938befdb3f31802a5077.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-28 12:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895
2026-03-28 12:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: facf7e4a-cc13-5a68-a60c-79ce99195938 with identifier: PF57895 to the API
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_ebb10c689fa91adfbd98614c329e9f20.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:27Z',
 'fuel_type': 'petrol',
 'id': 'facf7e4a-cc13-5a68-a60c-79ce99195938',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF57895',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 104736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_57ab2bf1a28f27b5e161d5f449e235e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_0215a50adf55d9d506cd79722cf60651.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_ebb10c689fa91adfbd98614c329e9f20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_dd1d63c88a3aed5f69ef0326b8c84bec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_9b56841893a579490a7c64b8b010ad00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_8f239f2600151797b7dd795e8a4836bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_facf7e4a-cc13-5a68-a60c-79ce99195938/facf7e4a-cc13-5a68-a60c-79ce99195938_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/ed/f7edd0596396935ed70b82d16156253a/pa/PF57895_b529b37244d9a6e70aea95f4eed3862c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF57895%27 HTTP/1.1" 200 None
2026-03-28 12:11:06 [auto1.nl] INFO: Saving data for PF57895: {'created_time': 1774699866.732402, 'last_price_update_time': 1774699866.732411, 'auction_closing_time': 1774884267.0}
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PF57895') HTTP/1.1" 204 0
2026-03-28 12:11:06 [scrapy.extensions.logstats] INFO: Crawled 94 pages (at 94 pages/min), scraped 43 items (at 43 items/min)
2026-03-28 12:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a065d50>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fd2%252Fa7d2940b53968d1435d5e5ba76a9d175%252Fpa%252FJW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg saved to cache
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253
2026-03-28 12:11:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253, skipping ID generation
2026-03-28 12:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with scrape type 1
2026-03-28 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 sending to next pipeline
2026-03-28 12:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253, identifier: JW97628
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951c450>
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F97%252F4b97ef408bc3dd438e92dc5a273f4b4f%252Fpa%252FUY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg saved to cache
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a
2026-03-28 12:11:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3d0faeeb-f16f-541d-bea7-50558d26ec2a, skipping ID generation
2026-03-28 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a with scrape type 1
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3d0faeeb-f16f-541d-bea7-50558d26ec2a sending to next pipeline
2026-03-28 12:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3d0faeeb-f16f-541d-bea7-50558d26ec2a, identifier: UY86442
2026-03-28 12:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-28 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 1
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_09325413dbc8eca97b5c5c534005d53f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_09325413dbc8eca97b5c5c534005d53f.jpg not downloaded yet
2026-03-28 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f5d450>
2026-03-28 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fda%252F0bda32392becb1b974a3a706f5b4bafe%252Fpa%252FWY33906_4233f8fdfc80938befdb3f31802a5077.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4233f8fdfc80938befdb3f31802a5077.jpg saved to cache
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2313a936-a8e6-5709-83cc-5140e234e2f4
2026-03-28 12:11:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2313a936-a8e6-5709-83cc-5140e234e2f4, skipping ID generation
2026-03-28 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2313a936-a8e6-5709-83cc-5140e234e2f4 with scrape type 1
2026-03-28 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2313a936-a8e6-5709-83cc-5140e234e2f4 sending to next pipeline
2026-03-28 12:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2313a936-a8e6-5709-83cc-5140e234e2f4, identifier: WY33906
2026-03-28 12:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-28 12:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628
2026-03-28 12:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bf3e8cb-800f-53ec-9b70-964ffd7eb253 with identifier: JW97628 to the API
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.4L',
 'engine_horse_power': 162,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '4bf3e8cb-800f-53ec-9b70-964ffd7eb253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '85RDJD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW97628',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Hyundai',
 'model': 'Sonata',
 'odometer': 281747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_315412762fb1bac6834b120e09001cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_7e4684768cc5c71d13f0e91d967aac1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_aaa2a9a4a249dedb6c73b07db5c95d37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_a05a4d888fa7b1e8ba46ac6e6d023dc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bf3e8cb-800f-53ec-9b70-964ffd7eb253/4bf3e8cb-800f-53ec-9b70-964ffd7eb253_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/d2/a7d2940b53968d1435d5e5ba76a9d175/pa/JW97628_4e96a3f2ee29ee231dcb1686bda8259a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Sonata 2.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2005}
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW97628%27 HTTP/1.1" 200 None
2026-03-28 12:11:07 [auto1.nl] INFO: Saving data for JW97628: {'created_time': 1774699867.662163, 'last_price_update_time': 1774699867.662173, 'auction_closing_time': 1774885795.0}
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW97628') HTTP/1.1" 204 0
2026-03-28 12:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-28 12:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442
2026-03-28 12:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3d0faeeb-f16f-541d-bea7-50558d26ec2a with identifier: UY86442 to the API
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:37Z',
 'fuel_type': 'diesel',
 'id': '3d0faeeb-f16f-541d-bea7-50558d26ec2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HT179T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY86442',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 288855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fb35f0410f5535ce9f3aa7f1e4ed7318.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2354886,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_fbe18cbc5fab316bfc5004d05db11781.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_1a3a30f0b87f9b3bce5187aed3a96fd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_396603fe08043fc9a8b3fd3a09cf2d66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459568,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5f777999f51b5af2c25b4ebaf5fa8dc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_85f4fa6f6586f8030d5bff4f8d5bed13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_17d9673fc7a130ddbd2f75a3e28eb8a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428075,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_62022a14c3ea0ef852bc8d5dd0a821e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_14595172ff552cfe59a8ccfc55a4679d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d0faeeb-f16f-541d-bea7-50558d26ec2a/3d0faeeb-f16f-541d-bea7-50558d26ec2a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/97/4b97ef408bc3dd438e92dc5a273f4b4f/pa/UY86442_5e4d5f9e58461f556c36b6151a97729b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI One D',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY86442%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.nl] INFO: Saving data for UY86442: {'created_time': 1774699868.035768, 'last_price_update_time': 1774699868.035776, 'auction_closing_time': 1774883257.0}
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UY86442') HTTP/1.1" 204 0
2026-03-28 12:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-28 12:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906
2026-03-28 12:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2313a936-a8e6-5709-83cc-5140e234e2f4 with identifier: WY33906 to the API
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4233f8fdfc80938befdb3f31802a5077.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'hybrid',
 'id': '2313a936-a8e6-5709-83cc-5140e234e2f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY33906',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 233495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a8c94d6e904bafc3bb46d134929627c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4233f8fdfc80938befdb3f31802a5077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_d1c92278a1e4fc0d5d2ca6d72ae4e142.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_56eb6c8431e7432681fed6edb1f90ec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_aaa8105bc1e8729f6219692b9e700a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_a6183ba09111652ab298d30240223fa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_4c6ee80236fa09dddc034d75dc8f0541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2313a936-a8e6-5709-83cc-5140e234e2f4/2313a936-a8e6-5709-83cc-5140e234e2f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/da/0bda32392becb1b974a3a706f5b4bafe/pa/WY33906_145c3d2153de5b19f9675832c9e9960b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2021}
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY33906%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [auto1.nl] INFO: Saving data for WY33906: {'created_time': 1774699868.391582, 'last_price_update_time': 1774699868.391592, 'auction_closing_time': 1774882995.0}
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY33906') HTTP/1.1" 204 0
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg not downloaded yet
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP36316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG85677> (referer: https://www.auto1.com/v1/car-details-view/XG85677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM15601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW57039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ45478/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE83954> (referer: https://www.auto1.com/v1/car-details-view/UE83954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg not downloaded yet
2026-03-28 12:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_f8fa6770701eddc9a7f654f37a245874.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_f8fa6770701eddc9a7f654f37a245874.jpg not downloaded yet
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg not downloaded yet
2026-03-28 12:11:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393bec10>
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg saved to cache
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ef8e50>
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg saved to cache
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg not downloaded yet
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg not downloaded yet
2026-03-28 12:11:09 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-28 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 1
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_8124620e9324fda4f90ec9a155688a23.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_8124620e9324fda4f90ec9a155688a23.jpg not downloaded yet
2026-03-28 12:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-28 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 1
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_ade02235430ab2cb79edac21dd6939fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_ade02235430ab2cb79edac21dd6939fa.jpg not downloaded yet
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for SE84312: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for PE73396: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for CY41827: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for ZG22704: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for PS09006: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for KB59261: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for PF97973: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for YG43162: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for MY36712: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for DT43342: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for XW63639: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [auto1.nl] INFO: Scrape type for MK25507: 0
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 12:11:09 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_7a78009c9340cad665c205c6502c2299.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_7a78009c9340cad665c205c6502c2299.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg not downloaded yet
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS29188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_22c33e86597bfb21a34bae8fce73dba6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_22c33e86597bfb21a34bae8fce73dba6.jpg not downloaded yet
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_f8fa6770701eddc9a7f654f37a245874.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_422b0548b61dc7facf7dc54bb1b52202.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_422b0548b61dc7facf7dc54bb1b52202.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_a010790830213fefe9adadee28b14d13.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_a010790830213fefe9adadee28b14d13.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg not downloaded yet
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg not downloaded yet
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg not downloaded yet
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ef8510>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0378d0>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_f8fa6770701eddc9a7f654f37a245874.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_f8fa6770701eddc9a7f654f37a245874.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393f4410>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_c875080d608c251a61fc2cb1352fd1af.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_c875080d608c251a61fc2cb1352fd1af.jpg not downloaded yet
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_7a78009c9340cad665c205c6502c2299.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_ade02235430ab2cb79edac21dd6939fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139636590>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139634710>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a07f310>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_7a78009c9340cad665c205c6502c2299.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_7a78009c9340cad665c205c6502c2299.jpg saved to cache
2026-03-28 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_09325413dbc8eca97b5c5c534005d53f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ91466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd4cd0>
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_ade02235430ab2cb79edac21dd6939fa.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_ade02235430ab2cb79edac21dd6939fa.jpg saved to cache
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV57262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139efab50>
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg saved to cache
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d6a50>
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F2c%252F532c98b716d3aa223687366da0c2ff03%252Fpa%252FTN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg saved to cache
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c436dec9-a348-5375-b382-724c7843d728
2026-03-28 12:11:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c436dec9-a348-5375-b382-724c7843d728, skipping ID generation
2026-03-28 12:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c436dec9-a348-5375-b382-724c7843d728 with scrape type 1
2026-03-28 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c436dec9-a348-5375-b382-724c7843d728 sending to next pipeline
2026-03-28 12:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c436dec9-a348-5375-b382-724c7843d728, identifier: TN45594
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_c875080d608c251a61fc2cb1352fd1af.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG71940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-28 12:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594
2026-03-28 12:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c436dec9-a348-5375-b382-724c7843d728 with identifier: TN45594 to the API
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:18:36Z',
 'fuel_type': 'diesel',
 'id': 'c436dec9-a348-5375-b382-724c7843d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XK-893-P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN45594',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 222353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_b280907dd4f442cc0aba4c2d7a9c4187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2942054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_58e74dae09a6db0b18ea3e9e4f1db185.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_9d0421266ac1b1959a87c0fe49f8a4bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2837096,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_c05e9e160a6a5e2992a251c97ebb38ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_028163e2399c29c474458ec69cbf49db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_4d9cd07cb5e022dead02bf468aeaad2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_1dd6157547faf847bc07c6ba6adbe033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_53ddcd623a65eb02189426d66410e9cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_33ea9fd403dec29ba09e8340ca13c0f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c436dec9-a348-5375-b382-724c7843d728/c436dec9-a348-5375-b382-724c7843d728_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895646,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/2c/532c98b716d3aa223687366da0c2ff03/pa/TN45594_e100e9ba57d0b04d3451a2d084e982a4.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN45594%27 HTTP/1.1" 200 None
2026-03-28 12:11:10 [auto1.nl] INFO: Saving data for TN45594: {'created_time': 1774699870.809288, 'last_price_update_time': 1774699870.809302, 'auction_closing_time': 1774883916.0}
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN45594') HTTP/1.1" 204 0
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM06318/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE09391> (referer: https://www.auto1.com/v1/car-details-view/ZE09391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH60865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a130e90>
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f27c10>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_09325413dbc8eca97b5c5c534005d53f.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_09325413dbc8eca97b5c5c534005d53f.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd2810>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a1533d0>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS42620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fb2610>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_c875080d608c251a61fc2cb1352fd1af.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_c875080d608c251a61fc2cb1352fd1af.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913941d690>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-28 12:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 1
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg not downloaded yet
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_c7d859856b491ff562a740555e659e95.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c7d859856b491ff562a740555e659e95.jpg not downloaded yet
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_c33a532cb626962e08d7b8eaac977358.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c33a532cb626962e08d7b8eaac977358.jpg not downloaded yet
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_57f3b84daa32ed866d485e2423a531ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_57f3b84daa32ed866d485e2423a531ed.jpg not downloaded yet
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg not downloaded yet
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_a010790830213fefe9adadee28b14d13.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg not downloaded yet
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_422b0548b61dc7facf7dc54bb1b52202.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_f25d0d837ba4553d30f864305f386620.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f25d0d837ba4553d30f864305f386620.jpg not downloaded yet
2026-03-28 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg not downloaded yet
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_8124620e9324fda4f90ec9a155688a23.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_f809e9dff8189615ee129178c6ee980c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f809e9dff8189615ee129178c6ee980c.jpg not downloaded yet
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg not downloaded yet
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913d93a490>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_a010790830213fefe9adadee28b14d13.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_a010790830213fefe9adadee28b14d13.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_22c33e86597bfb21a34bae8fce73dba6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b00d0>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_422b0548b61dc7facf7dc54bb1b52202.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_422b0548b61dc7facf7dc54bb1b52202.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139647490>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393dd150>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91396179d0>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_8124620e9324fda4f90ec9a155688a23.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_8124620e9324fda4f90ec9a155688a23.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913befdf90>
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fba%252F99ba88552ef14b89fd74b5c5052af3d9%252Fpa%252FXG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg saved to cache
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 74da6829-81b5-54dc-a369-acff1d44363f
2026-03-28 12:11:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 74da6829-81b5-54dc-a369-acff1d44363f, skipping ID generation
2026-03-28 12:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74da6829-81b5-54dc-a369-acff1d44363f with scrape type 1
2026-03-28 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 74da6829-81b5-54dc-a369-acff1d44363f sending to next pipeline
2026-03-28 12:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74da6829-81b5-54dc-a369-acff1d44363f, identifier: XG85677
2026-03-28 12:11:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394c9e90>
2026-03-28 12:11:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252F17%252Fee1744d25dafc9f761ebd7836880fc1f%252Fpa%252FUE83954_22c33e86597bfb21a34bae8fce73dba6.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_22c33e86597bfb21a34bae8fce73dba6.jpg saved to cache
2026-03-28 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355
2026-03-28 12:11:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355, skipping ID generation
2026-03-28 12:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with scrape type 1
2026-03-28 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 sending to next pipeline
2026-03-28 12:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355, identifier: UE83954
2026-03-28 12:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-28 12:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677
2026-03-28 12:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74da6829-81b5-54dc-a369-acff1d44363f with identifier: XG85677 to the API
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:52Z',
 'fuel_type': 'hybrid',
 'id': '74da6829-81b5-54dc-a369-acff1d44363f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG85677',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 185756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_8124620e9324fda4f90ec9a155688a23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_7a78009c9340cad665c205c6502c2299.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_fa9fc0b6fac8d5cbc33014e8b3292e4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_422b0548b61dc7facf7dc54bb1b52202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_a7ae4ae95c5414bd61631e5e5ce51b0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_b0cd6df1c2c0a4a1376dfeadc3393a04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_0c7f6a1fcc93a2f2afc5d2a8c70e8e2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74da6829-81b5-54dc-a369-acff1d44363f/74da6829-81b5-54dc-a369-acff1d44363f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ba/99ba88552ef14b89fd74b5c5052af3d9/pa/XG85677_c875080d608c251a61fc2cb1352fd1af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG85677%27 HTTP/1.1" 200 None
2026-03-28 12:11:12 [auto1.nl] INFO: Saving data for XG85677: {'created_time': 1774699872.633596, 'last_price_update_time': 1774699872.633607, 'auction_closing_time': 1774886092.0}
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG85677') HTTP/1.1" 204 0
2026-03-28 12:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-28 12:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954
2026-03-28 12:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 82d1f1ee-93e1-5933-a02b-8dad2d0d8355 with identifier: UE83954 to the API
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_22c33e86597bfb21a34bae8fce73dba6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 470,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'electro',
 'id': '82d1f1ee-93e1-5933-a02b-8dad2d0d8355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE83954',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Tesla',
 'model': 'Model X',
 'odometer': 299370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_2fadd77c6b6686d148a17eac0f6a19d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_f30b3769d862a1b0528cf1e9bfa8d0cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_22c33e86597bfb21a34bae8fce73dba6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_e857fd401e5bb49e467fc4354e8d70e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_a010790830213fefe9adadee28b14d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_82d1f1ee-93e1-5933-a02b-8dad2d0d8355/82d1f1ee-93e1-5933-a02b-8dad2d0d8355_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/17/ee1744d25dafc9f761ebd7836880fc1f/pa/UE83954_6a8ee9f7b5ca23f271e2f4730bdf5107.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model X 100D Dual',
 'transmission': 'automatic',
 'trim': 'Dual',
 'year': 2018}
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE83954%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [auto1.nl] INFO: Saving data for UE83954: {'created_time': 1774699873.029483, 'last_price_update_time': 1774699873.029495, 'auction_closing_time': 1774883152.0}
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE83954') HTTP/1.1" 204 0
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c33a532cb626962e08d7b8eaac977358.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f809e9dff8189615ee129178c6ee980c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS42620> (referer: https://www.auto1.com/v1/car-details-view/GS42620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f25d0d837ba4553d30f864305f386620.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS29188> (referer: https://www.auto1.com/v1/car-details-view/VS29188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW57039> (referer: https://www.auto1.com/v1/car-details-view/RW57039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ91466> (referer: https://www.auto1.com/v1/car-details-view/YJ91466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM15601> (referer: https://www.auto1.com/v1/car-details-view/HM15601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV57262> (referer: https://www.auto1.com/v1/car-details-view/MV57262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ45478> (referer: https://www.auto1.com/v1/car-details-view/ZZ45478/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394ca710>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913955c7d0>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f55350>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_c33a532cb626962e08d7b8eaac977358.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c33a532cb626962e08d7b8eaac977358.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393b7290>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_f809e9dff8189615ee129178c6ee980c.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f809e9dff8189615ee129178c6ee980c.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c929727d-ced9-597b-b6fe-4f982e0da845 with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_51fd5faa942c1d101e05f26afa416ed7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_51fd5faa942c1d101e05f26afa416ed7.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg not downloaded yet
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_5362c101182d5af25b3805e1b961ec82.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_5362c101182d5af25b3805e1b961ec82.jpg not downloaded yet
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394dc4d0>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_f25d0d837ba4553d30f864305f386620.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f25d0d837ba4553d30f864305f386620.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e2502d-82d3-5114-98c3-29dc66abc3a0 with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_60d9410a40ec4568c68d5b2a2245b626.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_60d9410a40ec4568c68d5b2a2245b626.jpg not downloaded yet
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_bf6e726ae308ecf8299668387683c571.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf6e726ae308ecf8299668387683c571.jpg not downloaded yet
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg not downloaded yet
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41034e0-3e6a-5956-9bab-f3ff15d849cf with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg not downloaded yet
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115aff30-f8cd-5ade-a05f-8496a45db92e with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg not downloaded yet
2026-03-28 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-28 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef with scrape type 1
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_af8b19ee071fd7484010d1854f430985.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_af8b19ee071fd7484010d1854f430985.jpg not downloaded yet
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c7d859856b491ff562a740555e659e95.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_3544fabd2cadcefb600573479a7da4fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_3544fabd2cadcefb600573479a7da4fc.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_363f1aff99a74d51602ae4e835345ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_363f1aff99a74d51602ae4e835345ec8.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_232bc0a7ada9a1a883c8e020c495b266.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_232bc0a7ada9a1a883c8e020c495b266.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_493dfc982b4f9265c9ed1a029ebea240.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_493dfc982b4f9265c9ed1a029ebea240.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_e0f34a53803439b66ac5b2d8283050bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_e0f34a53803439b66ac5b2d8283050bf.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_bf43a4d79b4339f92aab45084188a878.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf43a4d79b4339f92aab45084188a878.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_d909323f18850a212606a9d0d06f867f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_d909323f18850a212606a9d0d06f867f.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_5835b75d295f4545c64fa0c6889d32fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_5835b75d295f4545c64fa0c6889d32fd.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_fe39fa087b3b3814e2f693c52b995483.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_fe39fa087b3b3814e2f693c52b995483.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg not downloaded yet
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394a4e50>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139445550>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_c7d859856b491ff562a740555e659e95.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c7d859856b491ff562a740555e659e95.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9149bb20d0>
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg saved to cache
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_af8b19ee071fd7484010d1854f430985.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_bc4351396dfc28bef9fc032ea54e1829.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_bc4351396dfc28bef9fc032ea54e1829.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_1205cbc523e32c249c5ec7249af19e11.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_1205cbc523e32c249c5ec7249af19e11.jpg not downloaded yet
2026-03-28 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_abf0294dffcf98e58cb738245b05fd44.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_abf0294dffcf98e58cb738245b05fd44.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_39641b4415dce6b96113b99cc06d7c54.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_39641b4415dce6b96113b99cc06d7c54.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg not downloaded yet
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_f6544720b96643537ef641b817e3eae7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_f6544720b96643537ef641b817e3eae7.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_3f01011f583e552e62818a95f94b1573.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_3f01011f583e552e62818a95f94b1573.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_f973c88d3a30abf2568a37ee6102e079.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_f973c88d3a30abf2568a37ee6102e079.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_96950032575662b15424dc6bb66748ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_96950032575662b15424dc6bb66748ae.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_429842d8c009a137e7dac73fa027e7c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_429842d8c009a137e7dac73fa027e7c1.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg not downloaded yet
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961c690>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_af8b19ee071fd7484010d1854f430985.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_af8b19ee071fd7484010d1854f430985.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_57f3b84daa32ed866d485e2423a531ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_1cad10a55a4f04017938f2db01ee351a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_1cad10a55a4f04017938f2db01ee351a.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_d5834fcc88da7b311945e679326f6a94.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d5834fcc88da7b311945e679326f6a94.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_22a1494d4dddb167a01490682312161d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_22a1494d4dddb167a01490682312161d.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_9bef60e542d8c7da75535063cca3a1c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_9bef60e542d8c7da75535063cca3a1c1.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_f9fb257ddeb53711bb30029d46eab705.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_f9fb257ddeb53711bb30029d46eab705.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg not downloaded yet
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f06650>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a11b450>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_fe39fa087b3b3814e2f693c52b995483.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_0f9602467c58628a2b408b72ebe97e3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_0f9602467c58628a2b408b72ebe97e3a.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_903c93ee574016d789b2fce13b764002.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_903c93ee574016d789b2fce13b764002.jpg not downloaded yet
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg not downloaded yet
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a123e90>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_57f3b84daa32ed866d485e2423a531ed.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_57f3b84daa32ed866d485e2423a531ed.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393c58d0>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951be50>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_1127d9b6329fd3368597194db316dc1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_1127d9b6329fd3368597194db316dc1a.jpg not downloaded yet
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK48702/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_96950032575662b15424dc6bb66748ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_429842d8c009a137e7dac73fa027e7c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP36316> (referer: https://www.auto1.com/v1/car-details-view/GP36316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG71940> (referer: https://www.auto1.com/v1/car-details-view/HG71940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH60865> (referer: https://www.auto1.com/v1/car-details-view/KH60865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM06318> (referer: https://www.auto1.com/v1/car-details-view/HM06318/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394baed0>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d4a50>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_fe39fa087b3b3814e2f693c52b995483.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_fe39fa087b3b3814e2f693c52b995483.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139edf110>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_f9fb257ddeb53711bb30029d46eab705.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394d5e10>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_96950032575662b15424dc6bb66748ae.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_96950032575662b15424dc6bb66748ae.jpg saved to cache
2026-03-28 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a13a850>
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg saved to cache
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:15 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394ea6d0>
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_429842d8c009a137e7dac73fa027e7c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_429842d8c009a137e7dac73fa027e7c1.jpg saved to cache
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9c4788-5458-5560-baf2-1f3702bf94b0 with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_92439784bab67101fa9a22bb27cd388f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_92439784bab67101fa9a22bb27cd388f.jpg not downloaded yet
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2261bba-4ad7-59f6-9065-e85e70f08a34 with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_fb49f61d1f09448bc65e4555b51f5415.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_fb49f61d1f09448bc65e4555b51f5415.jpg not downloaded yet
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_59d05149970465a2dbf1a9ee5911d27b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_59d05149970465a2dbf1a9ee5911d27b.jpg not downloaded yet
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg not downloaded yet
2026-03-28 12:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913929e250>
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252Fe0%252F75e0d83f13ed8ae802925de05263413c%252Fpa%252FSX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg saved to cache
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d, skipping ID generation
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd9da3f8-60c5-53cb-b2fd-c79459b82f5d sending to next pipeline
2026-03-28 12:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d, identifier: SX97177
2026-03-28 12:11:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91392cec50>
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F6e%252F4d6eb0159f28ed1fb58a56d08151a829%252Fpa%252FZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg saved to cache
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83
2026-03-28 12:11:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2427ff2f-a130-5e1b-8fbd-39683ea48d83, skipping ID generation
2026-03-28 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with scrape type 1
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2427ff2f-a130-5e1b-8fbd-39683ea48d83 sending to next pipeline
2026-03-28 12:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2427ff2f-a130-5e1b-8fbd-39683ea48d83, identifier: ZE09391
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f5cc90>
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg saved to cache
2026-03-28 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-28 12:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177
2026-03-28 12:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dd9da3f8-60c5-53cb-b2fd-c79459b82f5d with identifier: SX97177 to the API
2026-03-28 12:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:13Z',
 'fuel_type': 'diesel',
 'id': 'dd9da3f8-60c5-53cb-b2fd-c79459b82f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '28PFH1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX97177',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'BMW',
 'model': '5er',
 'odometer': 338851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168410,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_09325413dbc8eca97b5c5c534005d53f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9aa0aba705d6ab6554aea3d5165a68bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_7d37c8f9da5c0dd7ba4227e459be6d64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_f8fa6770701eddc9a7f654f37a245874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_16136ddbdeeabcbfb30a9d9a4c27b896.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_75acb2072047a8a81d4e59e6e7e4f0f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_91f08b65ee40e17e2e520c95c9f2007b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_ade02235430ab2cb79edac21dd6939fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_9b4f0ab9c7e168f15f876945ebc3a698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9da3f8-60c5-53cb-b2fd-c79459b82f5d/dd9da3f8-60c5-53cb-b2fd-c79459b82f5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/e0/75e0d83f13ed8ae802925de05263413c/pa/SX97177_76d5fc6b4800b5f658779ec30bd075e1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX97177%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Saving data for SX97177: {'created_time': 1774699876.173328, 'last_price_update_time': 1774699876.173373, 'auction_closing_time': 1774885453.0}
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SX97177') HTTP/1.1" 204 0
2026-03-28 12:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-28 12:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391
2026-03-28 12:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2427ff2f-a130-5e1b-8fbd-39683ea48d83 with identifier: ZE09391 to the API
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:49:26Z',
 'fuel_type': 'petrol',
 'id': '2427ff2f-a130-5e1b-8fbd-39683ea48d83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL068B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE09391',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 157731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_d341d13f3f5c22b34abcb9f8972831bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c7d859856b491ff562a740555e659e95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_c33a532cb626962e08d7b8eaac977358.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2143972,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_57f3b84daa32ed866d485e2423a531ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2065159,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8243e957db52c1e0ed0f4d1cad2624fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2013857,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_012cbf1c37caa0ca7a0fb8d32bc69995.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f25d0d837ba4553d30f864305f386620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2215363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_0cd8936c5777c3b64f874dd4a2d75d66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_f809e9dff8189615ee129178c6ee980c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2427ff2f-a130-5e1b-8fbd-39683ea48d83/2427ff2f-a130-5e1b-8fbd-39683ea48d83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/6e/4d6eb0159f28ed1fb58a56d08151a829/pa/ZE09391_8ea884be6d57da18474e1bbd7fc81eed.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE09391%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Saving data for ZE09391: {'created_time': 1774699876.542312, 'last_price_update_time': 1774699876.542323, 'auction_closing_time': 1774885766.0}
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE09391') HTTP/1.1" 204 0
2026-03-28 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_1127d9b6329fd3368597194db316dc1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for KT18322: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for LZ16632: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for GY66252: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for UD70514: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for SM80467: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for EW85240: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for GY89787: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for EX12849: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for VL07732: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for TH30413: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for LB35433: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for EV30454: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for AW15981: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for DW43709: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [auto1.nl] INFO: Scrape type for MU55364: 0
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 12:11:16 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_20f270d70da974cdf16f679588383cc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_20f270d70da974cdf16f679588383cc8.jpg not downloaded yet
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_112b4ff45e346c75bface517d5528145.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_112b4ff45e346c75bface517d5528145.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_862de6647234da18fea2c00479140d54.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_862de6647234da18fea2c00479140d54.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_9a008c092fb419c94b17d96a6652119c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_9a008c092fb419c94b17d96a6652119c.jpg not downloaded yet
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_903c93ee574016d789b2fce13b764002.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_897d7c2c7297beeb90678d00c91cea33.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_897d7c2c7297beeb90678d00c91cea33.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_735de6f0378a886209f9462de9a3e65b.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_735de6f0378a886209f9462de9a3e65b.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_67313943b62a52767d51395ff607bad9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_67313943b62a52767d51395ff607bad9.jpg not downloaded yet
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a046090>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913942df50>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_f9fb257ddeb53711bb30029d46eab705.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_f9fb257ddeb53711bb30029d46eab705.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_0f9602467c58628a2b408b72ebe97e3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX89333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f22a10>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_1127d9b6329fd3368597194db316dc1a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_1127d9b6329fd3368597194db316dc1a.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_56e7c1ad3ac33227731db93c763f49b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_56e7c1ad3ac33227731db93c763f49b6.jpg not downloaded yet
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139647a90>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139523850>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f328d0>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913951ba10>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_903c93ee574016d789b2fce13b764002.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_903c93ee574016d789b2fce13b764002.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_8db788fd54702bb7bb3414a59655e510.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_8db788fd54702bb7bb3414a59655e510.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_185b68e0a455dface246f57f31cd3813.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_185b68e0a455dface246f57f31cd3813.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_5a6637677b0c90897de4077daafd03a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_5a6637677b0c90897de4077daafd03a7.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_84d754bdb5090237a9a428216c1d7eb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_84d754bdb5090237a9a428216c1d7eb7.jpg not downloaded yet
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_fb49f61d1f09448bc65e4555b51f5415.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_112b4ff45e346c75bface517d5528145.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_9a008c092fb419c94b17d96a6652119c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_59d05149970465a2dbf1a9ee5911d27b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_7c7922dee87e44c7ad419b10a1462893.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_7c7922dee87e44c7ad419b10a1462893.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_016e8afd2dc40fac67e68c7c88448df9.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_016e8afd2dc40fac67e68c7c88448df9.jpg not downloaded yet
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fed0d0>
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_0f9602467c58628a2b408b72ebe97e3a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_0f9602467c58628a2b408b72ebe97e3a.jpg saved to cache
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_20f270d70da974cdf16f679588383cc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_22f7adb709233bd9412535d1a8de6f67.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_22f7adb709233bd9412535d1a8de6f67.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_46240217e46b14ca627103ed7ccc8f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_46240217e46b14ca627103ed7ccc8f70.jpg not downloaded yet
2026-03-28 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_92439784bab67101fa9a22bb27cd388f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_862de6647234da18fea2c00479140d54.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d5834fcc88da7b311945e679326f6a94.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_bc0c4864fae826f931b8aa2f304e7958.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_bc0c4864fae826f931b8aa2f304e7958.jpg not downloaded yet
2026-03-28 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg not downloaded yet
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_48ef1a7547cd83b51a32eef36677347d.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_48ef1a7547cd83b51a32eef36677347d.jpg not downloaded yet
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_4574287d789bc688a7f1a11f79967feb.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_4574287d789bc688a7f1a11f79967feb.jpg not downloaded yet
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_1cad10a55a4f04017938f2db01ee351a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913968a790>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_fb49f61d1f09448bc65e4555b51f5415.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_fb49f61d1f09448bc65e4555b51f5415.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913942a5d0>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_112b4ff45e346c75bface517d5528145.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_112b4ff45e346c75bface517d5528145.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a07d490>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_9a008c092fb419c94b17d96a6652119c.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_9a008c092fb419c94b17d96a6652119c.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a10f310>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_59d05149970465a2dbf1a9ee5911d27b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_59d05149970465a2dbf1a9ee5911d27b.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_84d754bdb5090237a9a428216c1d7eb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_728eeab54a96b9aae3ff578980298e27.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_728eeab54a96b9aae3ff578980298e27.jpg not downloaded yet
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_5a6637677b0c90897de4077daafd03a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_9bef60e542d8c7da75535063cca3a1c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_67313943b62a52767d51395ff607bad9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_22a1494d4dddb167a01490682312161d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg not downloaded yet
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ec5390>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139442010>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_20f270d70da974cdf16f679588383cc8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_20f270d70da974cdf16f679588383cc8.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a120750>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_92439784bab67101fa9a22bb27cd388f.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_92439784bab67101fa9a22bb27cd388f.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139440bd0>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_862de6647234da18fea2c00479140d54.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_862de6647234da18fea2c00479140d54.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395051d0>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_d5834fcc88da7b311945e679326f6a94.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d5834fcc88da7b311945e679326f6a94.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139441550>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_1cad10a55a4f04017938f2db01ee351a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_1cad10a55a4f04017938f2db01ee351a.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_8db788fd54702bb7bb3414a59655e510.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_185b68e0a455dface246f57f31cd3813.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394deb50>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_84d754bdb5090237a9a428216c1d7eb7.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_84d754bdb5090237a9a428216c1d7eb7.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1e9750>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_5a6637677b0c90897de4077daafd03a7.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_5a6637677b0c90897de4077daafd03a7.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f0c950>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_9bef60e542d8c7da75535063cca3a1c1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_9bef60e542d8c7da75535063cca3a1c1.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f3b190>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_67313943b62a52767d51395ff607bad9.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_67313943b62a52767d51395ff607bad9.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913944ef90>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_22a1494d4dddb167a01490682312161d.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_22a1494d4dddb167a01490682312161d.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_016e8afd2dc40fac67e68c7c88448df9.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a002610>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_8db788fd54702bb7bb3414a59655e510.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_8db788fd54702bb7bb3414a59655e510.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394c8690>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_185b68e0a455dface246f57f31cd3813.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_185b68e0a455dface246f57f31cd3813.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_4574287d789bc688a7f1a11f79967feb.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_46240217e46b14ca627103ed7ccc8f70.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_f973c88d3a30abf2568a37ee6102e079.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x03\xe8'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 98 - value: b'SM-G991B\x00'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x02\xee'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 107 - value: b'samsung\x00'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x87'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 12:11:18 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 115 - value: b'2026:03:24 12:30:24\x00'
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394de350>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_016e8afd2dc40fac67e68c7c88448df9.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_016e8afd2dc40fac67e68c7c88448df9.jpg saved to cache
2026-03-28 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394dd890>
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_22f7adb709233bd9412535d1a8de6f67.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_728eeab54a96b9aae3ff578980298e27.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f0d390>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f3a190>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_4574287d789bc688a7f1a11f79967feb.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_4574287d789bc688a7f1a11f79967feb.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x03\xe8'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 98 - value: b'SM-G991B\x00'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x02\xee'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 107 - value: b'samsung\x00'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x87'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 115 - value: b'2026:03:24 12:31:05\x00'
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fa7c50>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_46240217e46b14ca627103ed7ccc8f70.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_46240217e46b14ca627103ed7ccc8f70.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913960cf50>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_f973c88d3a30abf2568a37ee6102e079.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_f973c88d3a30abf2568a37ee6102e079.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_bc0c4864fae826f931b8aa2f304e7958.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_7c7922dee87e44c7ad419b10a1462893.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_48ef1a7547cd83b51a32eef36677347d.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a06cc10>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a0166d0>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_9.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a110cd0>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_22f7adb709233bd9412535d1a8de6f67.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_22f7adb709233bd9412535d1a8de6f67.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a014d90>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_8.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_728eeab54a96b9aae3ff578980298e27.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_728eeab54a96b9aae3ff578980298e27.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394b5790>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ec7dd0>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_735de6f0378a886209f9462de9a3e65b.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX89333> (referer: https://www.auto1.com/v1/car-details-view/PX89333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK48702> (referer: https://www.auto1.com/v1/car-details-view/HK48702/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_56e7c1ad3ac33227731db93c763f49b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fd4290>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_bc0c4864fae826f931b8aa2f304e7958.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_bc0c4864fae826f931b8aa2f304e7958.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395180d0>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_7c7922dee87e44c7ad419b10a1462893.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_7c7922dee87e44c7ad419b10a1462893.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913960eb10>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_7.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_48ef1a7547cd83b51a32eef36677347d.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_48ef1a7547cd83b51a32eef36677347d.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a06ec50>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_3f01011f583e552e62818a95f94b1573.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_39641b4415dce6b96113b99cc06d7c54.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_f6544720b96643537ef641b817e3eae7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f3a950>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91394454d0>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f23010>
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg46%252Fd7%252F46d73d538985a9190b6c5cb2de0e2cdc%252Fpa%252FHG71940_735de6f0378a886209f9462de9a3e65b.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_735de6f0378a886209f9462de9a3e65b.jpg saved to cache
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2261bba-4ad7-59f6-9065-e85e70f08a34
2026-03-28 12:11:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2261bba-4ad7-59f6-9065-e85e70f08a34, skipping ID generation
2026-03-28 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2261bba-4ad7-59f6-9065-e85e70f08a34 with scrape type 1
2026-03-28 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2261bba-4ad7-59f6-9065-e85e70f08a34 sending to next pipeline
2026-03-28 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2261bba-4ad7-59f6-9065-e85e70f08a34, identifier: HG71940
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1e9450>
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Ff6%252F6ef69b401e72bc2a576f879c82745173%252Fpa%252FKH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg saved to cache
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99
2026-03-28 12:11:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 35cd0ea0-88b0-5bb6-bb50-23592071ea99, skipping ID generation
2026-03-28 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with scrape type 1
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 35cd0ea0-88b0-5bb6-bb50-23592071ea99 sending to next pipeline
2026-03-28 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35cd0ea0-88b0-5bb6-bb50-23592071ea99, identifier: KH60865
2026-03-28 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-28 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with scrape type 1
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg not downloaded yet
2026-03-28 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-28 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce22037-fda4-5392-8390-f9d4c00e222e with scrape type 1
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg not downloaded yet
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageWidth (256) - type: long (4) - value: b'\x00\x00\x03\xe8'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 98 - value: b'SM-G991B\x00'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ImageLength (257) - type: long (4) - value: b'\x00\x00\x02\xee'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 58 - Data Location: 107 - value: b'samsung\x00'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x87'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 12:11:20 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 115 - value: b'2026:03:24 12:31:11\x00'
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139518a90>
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F67%252F8a67b7d86ed05770a98de402d6610fd2%252Fpa%252FHM06318_56e7c1ad3ac33227731db93c763f49b6.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_56e7c1ad3ac33227731db93c763f49b6.jpg saved to cache
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52ccd898-0669-55ff-92da-5fac068ba1c4
2026-03-28 12:11:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52ccd898-0669-55ff-92da-5fac068ba1c4, skipping ID generation
2026-03-28 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52ccd898-0669-55ff-92da-5fac068ba1c4 with scrape type 1
2026-03-28 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52ccd898-0669-55ff-92da-5fac068ba1c4 sending to next pipeline
2026-03-28 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 52ccd898-0669-55ff-92da-5fac068ba1c4, identifier: HM06318
2026-03-28 12:11:20 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_897d7c2c7297beeb90678d00c91cea33.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_abf0294dffcf98e58cb738245b05fd44.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf43a4d79b4339f92aab45084188a878.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-28 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940
2026-03-28 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2261bba-4ad7-59f6-9065-e85e70f08a34 with identifier: HG71940 to the API
2026-03-28 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_735de6f0378a886209f9462de9a3e65b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:55:08Z',
 'fuel_type': 'electro',
 'id': 'd2261bba-4ad7-59f6-9065-e85e70f08a34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG71940',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 115176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_fb49f61d1f09448bc65e4555b51f5415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_112b4ff45e346c75bface517d5528145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_735de6f0378a886209f9462de9a3e65b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_9500d9422f487c5e6803e7cc0ca5c1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_185b68e0a455dface246f57f31cd3813.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_948d41f2f9aaa5469d7d09195d7e0d88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104501,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_22f7adb709233bd9412535d1a8de6f67.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2261bba-4ad7-59f6-9065-e85e70f08a34/d2261bba-4ad7-59f6-9065-e85e70f08a34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img46/d7/46d73d538985a9190b6c5cb2de0e2cdc/pa/HG71940_12e643cf4f88723e39be5e0e68eed9f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Enyaq iV 60 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2021}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG71940%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.nl] INFO: Saving data for HG71940: {'created_time': 1774699881.114814, 'last_price_update_time': 1774699881.114825, 'auction_closing_time': 1774886108.0}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HG71940') HTTP/1.1" 204 0
2026-03-28 12:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-28 12:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865
2026-03-28 12:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35cd0ea0-88b0-5bb6-bb50-23592071ea99 with identifier: KH60865 to the API
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:38Z',
 'fuel_type': 'diesel',
 'id': '35cd0ea0-88b0-5bb6-bb50-23592071ea99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '8XVD54',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH60865',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 319669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_59d05149970465a2dbf1a9ee5911d27b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_862de6647234da18fea2c00479140d54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_e8aa151ad7a0fd570d2cf9d0910a3c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_cc10797a94bcf68ab1d06f3f41dc7902.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_5a6637677b0c90897de4077daafd03a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_fed93e8a42009c92bbdee4e8ef45eb16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_73a195dfa07b3e0ad360b03275dbcad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_48ef1a7547cd83b51a32eef36677347d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_728eeab54a96b9aae3ff578980298e27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_35cd0ea0-88b0-5bb6-bb50-23592071ea99/35cd0ea0-88b0-5bb6-bb50-23592071ea99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/f6/6ef69b401e72bc2a576f879c82745173/pa/KH60865_578cb9cd88b5cb1e27653914da1ebda1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH60865%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.nl] INFO: Saving data for KH60865: {'created_time': 1774699881.561968, 'last_price_update_time': 1774699881.561977, 'auction_closing_time': 1774884938.0}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH60865') HTTP/1.1" 204 0
2026-03-28 12:11:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-28 12:11:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318
2026-03-28 12:11:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 52ccd898-0669-55ff-92da-5fac068ba1c4 with identifier: HM06318 to the API
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_56e7c1ad3ac33227731db93c763f49b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 514,
 'expiration_date': '2026-03-30T15:53:17Z',
 'fuel_type': 'electro',
 'id': '52ccd898-0669-55ff-92da-5fac068ba1c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM06318',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 112245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 152636,
             'Height': 750,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_2adfb3e09b8683a9ed2224ad540fa8ec.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_9a008c092fb419c94b17d96a6652119c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146755,
             'Height': 750,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_67313943b62a52767d51395ff607bad9.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 450069,
             'Height': 750,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_56e7c1ad3ac33227731db93c763f49b6.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_84d754bdb5090237a9a428216c1d7eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324866,
             'Height': 750,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_016e8afd2dc40fac67e68c7c88448df9.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 341254,
             'Height': 750,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_46240217e46b14ca627103ed7ccc8f70.jpg',
             'Width': 1000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52ccd898-0669-55ff-92da-5fac068ba1c4/52ccd898-0669-55ff-92da-5fac068ba1c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/67/8a67b7d86ed05770a98de402d6610fd2/pa/HM06318_4574287d789bc688a7f1a11f79967feb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Max Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM06318%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.nl] INFO: Saving data for HM06318: {'created_time': 1774699881.914954, 'last_price_update_time': 1774699881.914964, 'auction_closing_time': 1774885997.0}
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM06318') HTTP/1.1" 204 0
2026-03-28 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_1205cbc523e32c249c5ec7249af19e11.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_bc4351396dfc28bef9fc032ea54e1829.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_26d9fe2ac97051140303203b786ae06c.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_26d9fe2ac97051140303203b786ae06c.jpg not downloaded yet
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg not downloaded yet
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-28 12:11:21 [auto1.nl] INFO: Scrape type for PV96248: 0
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 12:11:21 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for VV45583: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for WF02438: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for RX16781: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for BZ05855: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for GP94169: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for LN29511: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for EF55235: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for JF44438: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for MM94423: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for JG46150: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for VB13156: 0
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 12:11:22 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [auto1.nl] INFO: Scrape type for LM76108: 0
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_5835b75d295f4545c64fa0c6889d32fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_d909323f18850a212606a9d0d06f867f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393e2850>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_3f01011f583e552e62818a95f94b1573.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_3f01011f583e552e62818a95f94b1573.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f27b50>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1f0210>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_39641b4415dce6b96113b99cc06d7c54.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_39641b4415dce6b96113b99cc06d7c54.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a122f50>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_f6544720b96643537ef641b817e3eae7.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_f6544720b96643537ef641b817e3eae7.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_493dfc982b4f9265c9ed1a029ebea240.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_e0f34a53803439b66ac5b2d8283050bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg not downloaded yet
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_7679ea0024055c2dda11fb8bbec69e15.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_7679ea0024055c2dda11fb8bbec69e15.jpg not downloaded yet
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913955cf90>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F0c%252Fed0cde19b5e5a1494d8ef69544101904%252Fpa%252FGP36316_897d7c2c7297beeb90678d00c91cea33.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_897d7c2c7297beeb90678d00c91cea33.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a9c4788-5458-5560-baf2-1f3702bf94b0
2026-03-28 12:11:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a9c4788-5458-5560-baf2-1f3702bf94b0, skipping ID generation
2026-03-28 12:11:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9c4788-5458-5560-baf2-1f3702bf94b0 with scrape type 1
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a9c4788-5458-5560-baf2-1f3702bf94b0 sending to next pipeline
2026-03-28 12:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5a9c4788-5458-5560-baf2-1f3702bf94b0, identifier: GP36316
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a11ce90>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_abf0294dffcf98e58cb738245b05fd44.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_abf0294dffcf98e58cb738245b05fd44.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393cf990>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_bf43a4d79b4339f92aab45084188a878.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf43a4d79b4339f92aab45084188a878.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913bea9d90>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_1205cbc523e32c249c5ec7249af19e11.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_1205cbc523e32c249c5ec7249af19e11.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393d4950>
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_bc4351396dfc28bef9fc032ea54e1829.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_bc4351396dfc28bef9fc032ea54e1829.jpg saved to cache
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg not downloaded yet
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_bc918c162fcf63b6caa79186fbdc322e.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_bc918c162fcf63b6caa79186fbdc322e.jpg not downloaded yet
2026-03-28 12:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-28 12:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316
2026-03-28 12:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5a9c4788-5458-5560-baf2-1f3702bf94b0 with identifier: GP36316 to the API
2026-03-28 12:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_897d7c2c7297beeb90678d00c91cea33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:50:23Z',
 'fuel_type': 'hybrid',
 'id': '5a9c4788-5458-5560-baf2-1f3702bf94b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP36316',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Lynk & Co',
 'model': '01',
 'odometer': 101274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267691,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_92439784bab67101fa9a22bb27cd388f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 224102,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_20f270d70da974cdf16f679588383cc8.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228116,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_897d7c2c7297beeb90678d00c91cea33.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 269326,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_708cbfc97e4c6202f7cd34b7b23058a6.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185616,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_8db788fd54702bb7bb3414a59655e510.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206984,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_7c7922dee87e44c7ad419b10a1462893.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238345,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_3e607c6c32b9a7da49595a0d0608a1f4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a9c4788-5458-5560-baf2-1f3702bf94b0/5a9c4788-5458-5560-baf2-1f3702bf94b0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/0c/ed0cde19b5e5a1494d8ef69544101904/pa/GP36316_bc0c4864fae826f931b8aa2f304e7958.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lynk & Co 01 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP36316%27 HTTP/1.1" 200 None
2026-03-28 12:11:23 [auto1.nl] INFO: Saving data for GP36316: {'created_time': 1774699883.18416, 'last_price_update_time': 1774699883.18417, 'auction_closing_time': 1774885823.0}
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP36316') HTTP/1.1" 204 0
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139edd150>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_5835b75d295f4545c64fa0c6889d32fd.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_5835b75d295f4545c64fa0c6889d32fd.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a119690>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_d909323f18850a212606a9d0d06f867f.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_d909323f18850a212606a9d0d06f867f.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_232bc0a7ada9a1a883c8e020c495b266.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_3544fabd2cadcefb600573479a7da4fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_363f1aff99a74d51602ae4e835345ec8.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf6e726ae308ecf8299668387683c571.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_6193f5078ed33b97f6ac300be52846ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_6193f5078ed33b97f6ac300be52846ba.jpg not downloaded yet
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_9e1d07251960432729d9f5c4a92847b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_9e1d07251960432729d9f5c4a92847b5.jpg not downloaded yet
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f561d0>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fd5%252Fded5892c79fb7108ba61f3a4b0dfeccd%252Fpa%252FMV57262_493dfc982b4f9265c9ed1a029ebea240.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_493dfc982b4f9265c9ed1a029ebea240.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 115aff30-f8cd-5ade-a05f-8496a45db92e
2026-03-28 12:11:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 115aff30-f8cd-5ade-a05f-8496a45db92e, skipping ID generation
2026-03-28 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 115aff30-f8cd-5ade-a05f-8496a45db92e with scrape type 1
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 115aff30-f8cd-5ade-a05f-8496a45db92e sending to next pipeline
2026-03-28 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 115aff30-f8cd-5ade-a05f-8496a45db92e, identifier: MV57262
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139411390>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_e0f34a53803439b66ac5b2d8283050bf.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_e0f34a53803439b66ac5b2d8283050bf.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395066d0>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F28%252F1728d37a9a8073614092a4453f017511%252Fpa%252FZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef
2026-03-28 12:11:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5d4dfb6-028c-5bf0-991e-b83ff5197eef, skipping ID generation
2026-03-28 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef with scrape type 1
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5d4dfb6-028c-5bf0-991e-b83ff5197eef sending to next pipeline
2026-03-28 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5d4dfb6-028c-5bf0-991e-b83ff5197eef, identifier: ZZ45478
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913946b190>
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg saved to cache
2026-03-28 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-28 12:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262
2026-03-28 12:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 115aff30-f8cd-5ade-a05f-8496a45db92e with identifier: MV57262 to the API
2026-03-28 12:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_493dfc982b4f9265c9ed1a029ebea240.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:12:21Z',
 'fuel_type': 'electro',
 'id': '115aff30-f8cd-5ade-a05f-8496a45db92e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV57262',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 103065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_32e1c92aa6f9a86332bf4752b35966eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_493dfc982b4f9265c9ed1a029ebea240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_fe39fa087b3b3814e2f693c52b995483.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_39641b4415dce6b96113b99cc06d7c54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_429842d8c009a137e7dac73fa027e7c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195490,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_f9fb257ddeb53711bb30029d46eab705.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_903c93ee574016d789b2fce13b764002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_115aff30-f8cd-5ade-a05f-8496a45db92e/115aff30-f8cd-5ade-a05f-8496a45db92e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/d5/ded5892c79fb7108ba61f3a4b0dfeccd/pa/MV57262_1127d9b6329fd3368597194db316dc1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV57262%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.nl] INFO: Saving data for MV57262: {'created_time': 1774699884.14666, 'last_price_update_time': 1774699884.146669, 'auction_closing_time': 1774883541.0}
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV57262') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-28 12:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478
2026-03-28 12:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5d4dfb6-028c-5bf0-991e-b83ff5197eef with identifier: ZZ45478 to the API
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:03:08Z',
 'fuel_type': 'electro',
 'id': 'f5d4dfb6-028c-5bf0-991e-b83ff5197eef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ45478',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 101042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_af8b19ee071fd7484010d1854f430985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123265,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e849c7835ad9af5fb8af3d83d4badd26.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_a3ac1393fcdf145b07d1b525edc20074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120926,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_e746f95f94628d3a38ee2e50205da88b.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179868,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_ae6532c8da4d8a3dba2cb71a0559a827.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_72d208f19249dc9f56d645ec65e0b668.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5d4dfb6-028c-5bf0-991e-b83ff5197eef/f5d4dfb6-028c-5bf0-991e-b83ff5197eef_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85120,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img17/28/1728d37a9a8073614092a4453f017511/pa/ZZ45478_60622c914b3cb0372dcf9d3b312c3e7d.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Enyaq iV 60 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2022}
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ45478%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [auto1.nl] INFO: Saving data for ZZ45478: {'created_time': 1774699884.539897, 'last_price_update_time': 1774699884.539909, 'auction_closing_time': 1774882988.0}
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ45478') HTTP/1.1" 204 0
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_dfb7152f46ec52744f16d08f48a5c209.jpg%27 HTTP/1.1" 200 None
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_dfb7152f46ec52744f16d08f48a5c209.jpg not downloaded yet
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139ece6d0>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_60d9410a40ec4568c68d5b2a2245b626.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139fb2790>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_232bc0a7ada9a1a883c8e020c495b266.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_232bc0a7ada9a1a883c8e020c495b266.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139414790>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_3544fabd2cadcefb600573479a7da4fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_3544fabd2cadcefb600573479a7da4fc.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913961d9d0>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_363f1aff99a74d51602ae4e835345ec8.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_363f1aff99a74d51602ae4e835345ec8.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91392b8510>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252F1c%252F421c5fc5730d917c4ff0d0455a2f51a4%252Fpa%252FRW57039_bf6e726ae308ecf8299668387683c571.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf6e726ae308ecf8299668387683c571.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44
2026-03-28 12:11:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44, skipping ID generation
2026-03-28 12:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with scrape type 1
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 sending to next pipeline
2026-03-28 12:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44, identifier: RW57039
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a04ebd0>
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg saved to cache
2026-03-28 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_5362c101182d5af25b3805e1b961ec82.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_26d9fe2ac97051140303203b786ae06c.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-28 12:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039
2026-03-28 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44 with identifier: RW57039 to the API
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf6e726ae308ecf8299668387683c571.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:13:32Z',
 'fuel_type': 'diesel',
 'id': 'ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW57039',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 183210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf6e726ae308ecf8299668387683c571.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_2f5ca1405d8e7e184b2f9da515cfe6e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_bf43a4d79b4339f92aab45084188a878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d80beac3bb9f386a70466ae44a4a9c58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_3f01011f583e552e62818a95f94b1573.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_d5834fcc88da7b311945e679326f6a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44/ca32860d-9fdf-52fc-a8f5-8cf8bb1f2e44_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/1c/421c5fc5730d917c4ff0d0455a2f51a4/pa/RW57039_e1e0b4b0535c8a1f15bc1eed27fa10ac.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Kasten Trend',
 'transmission': 'manual',
 'trim': 'Kasten Trend',
 'year': 2017}
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW57039%27 HTTP/1.1" 200 None
2026-03-28 12:11:25 [auto1.nl] INFO: Saving data for RW57039: {'created_time': 1774699885.277667, 'last_price_update_time': 1774699885.277675, 'auction_closing_time': 1774883612.0}
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW57039') HTTP/1.1" 204 0
2026-03-28 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_bc918c162fcf63b6caa79186fbdc322e.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_7679ea0024055c2dda11fb8bbec69e15.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913944a710>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252Fb1%252F7ab181dc48ef4d83c2e80fae5326af11%252Fpa%252FHM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d41034e0-3e6a-5956-9bab-f3ff15d849cf
2026-03-28 12:11:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d41034e0-3e6a-5956-9bab-f3ff15d849cf, skipping ID generation
2026-03-28 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41034e0-3e6a-5956-9bab-f3ff15d849cf with scrape type 1
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d41034e0-3e6a-5956-9bab-f3ff15d849cf sending to next pipeline
2026-03-28 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d41034e0-3e6a-5956-9bab-f3ff15d849cf, identifier: HM15601
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a049690>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F36%252F7036e42f7f2d9c6db2a5c4ca742411f3%252Fpa%252FVS29188_60d9410a40ec4568c68d5b2a2245b626.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_60d9410a40ec4568c68d5b2a2245b626.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28e2502d-82d3-5114-98c3-29dc66abc3a0
2026-03-28 12:11:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28e2502d-82d3-5114-98c3-29dc66abc3a0, skipping ID generation
2026-03-28 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e2502d-82d3-5114-98c3-29dc66abc3a0 with scrape type 1
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28e2502d-82d3-5114-98c3-29dc66abc3a0 sending to next pipeline
2026-03-28 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28e2502d-82d3-5114-98c3-29dc66abc3a0, identifier: VS29188
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913939cf90>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:25 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91392aab50>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139469290>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f35350>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_5362c101182d5af25b3805e1b961ec82.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_5362c101182d5af25b3805e1b961ec82.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913c1e6410>
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_26d9fe2ac97051140303203b786ae06c.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_26d9fe2ac97051140303203b786ae06c.jpg saved to cache
2026-03-28 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-28 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601
2026-03-28 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d41034e0-3e6a-5956-9bab-f3ff15d849cf with identifier: HM15601 to the API
2026-03-28 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.3L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'diesel',
 'id': 'd41034e0-3e6a-5956-9bab-f3ff15d849cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM15601',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 431750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213013,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_36b34659f6d1c3d5b0a81c26689bad6e.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_232bc0a7ada9a1a883c8e020c495b266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190003,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_5835b75d295f4545c64fa0c6889d32fd.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 222055,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_abf0294dffcf98e58cb738245b05fd44.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_96950032575662b15424dc6bb66748ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_9bef60e542d8c7da75535063cca3a1c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d41034e0-3e6a-5956-9bab-f3ff15d849cf/d41034e0-3e6a-5956-9bab-f3ff15d849cf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 257503,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/b1/7ab181dc48ef4d83c2e80fae5326af11/pa/HM15601_0f9602467c58628a2b408b72ebe97e3a.jpg',
             'Width': 1200}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI Ka L1H1 3,5t',
 'transmission': 'manual',
 'trim': 'Ka L1H1 3,5t',
 'year': 2016}
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM15601%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Saving data for HM15601: {'created_time': 1774699886.192287, 'last_price_update_time': 1774699886.192296, 'auction_closing_time': 1774882997.0}
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM15601') HTTP/1.1" 204 0
2026-03-28 12:11:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-28 12:11:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188
2026-03-28 12:11:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28e2502d-82d3-5114-98c3-29dc66abc3a0 with identifier: VS29188 to the API
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_60d9410a40ec4568c68d5b2a2245b626.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'electro',
 'id': '28e2502d-82d3-5114-98c3-29dc66abc3a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS29188',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 102100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_60d9410a40ec4568c68d5b2a2245b626.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_3544fabd2cadcefb600573479a7da4fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129480,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_e0f34a53803439b66ac5b2d8283050bf.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117752,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_bc4351396dfc28bef9fc032ea54e1829.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121561,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_f6544720b96643537ef641b817e3eae7.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118557,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_1cad10a55a4f04017938f2db01ee351a.jpg',
             'Width': 1024},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28e2502d-82d3-5114-98c3-29dc66abc3a0/28e2502d-82d3-5114-98c3-29dc66abc3a0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 124320,
             'Height': 768,
             'OriginUrl': 'https://img-pa.auto1.com/img70/36/7036e42f7f2d9c6db2a5c4ca742411f3/pa/VS29188_5e3de8d2e2aaeff6eafc35987443ab30.jpg',
             'Width': 1024}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW 1st Plus Pro Performance',
 'transmission': 'automatic',
 'trim': '1st Plus Pro Performance',
 'year': 2020}
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS29188%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Saving data for VS29188: {'created_time': 1774699886.552915, 'last_price_update_time': 1774699886.552925, 'auction_closing_time': 1774884048.0}
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VS29188') HTTP/1.1" 204 0
2026-03-28 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_6193f5078ed33b97f6ac300be52846ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for PC25819: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for UC83701: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for PN34137: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for AU62322: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for VD56637: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for YS68012: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for AS79214: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for SV22274: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for FD33602: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for UP56929: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for TK93788: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for NX58095: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for BH47891: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for ST98483: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for ZV50646: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 12:11:26 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-28 12:11:26 [auto1.nl] INFO: Scrape type for ZP53707: 0
2026-03-28 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_dfb7152f46ec52744f16d08f48a5c209.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_9e1d07251960432729d9f5c4a92847b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a132790>
2026-03-28 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_bc918c162fcf63b6caa79186fbdc322e.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_bc918c162fcf63b6caa79186fbdc322e.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a130290>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_7679ea0024055c2dda11fb8bbec69e15.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_7679ea0024055c2dda11fb8bbec69e15.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f06d90>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_6193f5078ed33b97f6ac300be52846ba.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_6193f5078ed33b97f6ac300be52846ba.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139544b10>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91393af550>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_dfb7152f46ec52744f16d08f48a5c209.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_dfb7152f46ec52744f16d08f48a5c209.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a06b610>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5a%252F4f5a23a3628bdaffb92d25a9586970bd%252Fpa%252FPX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a
2026-03-28 12:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a, skipping ID generation
2026-03-28 12:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with scrape type 1
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58b23ea0-4a17-5e96-98ed-2f8bf768d96a sending to next pipeline
2026-03-28 12:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a, identifier: PX89333
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f91395d0450>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fd0%252F68d061b64562a6dad18e190f3e2134f5%252Fpa%252FHK48702_9e1d07251960432729d9f5c4a92847b5.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_9e1d07251960432729d9f5c4a92847b5.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ce22037-fda4-5392-8390-f9d4c00e222e
2026-03-28 12:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ce22037-fda4-5392-8390-f9d4c00e222e, skipping ID generation
2026-03-28 12:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce22037-fda4-5392-8390-f9d4c00e222e with scrape type 1
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ce22037-fda4-5392-8390-f9d4c00e222e sending to next pipeline
2026-03-28 12:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ce22037-fda4-5392-8390-f9d4c00e222e, identifier: HK48702
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f913a196b90>
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1b%252F36%252F1b3689f9162c81bba4d931076f006a45%252Fpa%252FYJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg saved to cache
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5
2026-03-28 12:11:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5, skipping ID generation
2026-03-28 12:11:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with scrape type 1
2026-03-28 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 sending to next pipeline
2026-03-28 12:11:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5, identifier: YJ91466
2026-03-28 12:11:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-28 12:11:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333
2026-03-28 12:11:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58b23ea0-4a17-5e96-98ed-2f8bf768d96a with identifier: PX89333 to the API
2026-03-28 12:11:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:28:05Z',
 'fuel_type': 'petrol',
 'id': '58b23ea0-4a17-5e96-98ed-2f8bf768d96a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '46-ZF-HR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX89333',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 267476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_7eb1e3fcee0496be4f6420d082cf51f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_26d9fe2ac97051140303203b786ae06c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_a9f3ffe5c6d7b809827f80731230c36f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_0b66d5bc0c813f55302653c8f339a2b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_6193f5078ed33b97f6ac300be52846ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_58b23ea0-4a17-5e96-98ed-2f8bf768d96a/58b23ea0-4a17-5e96-98ed-2f8bf768d96a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5a/4f5a23a3628bdaffb92d25a9586970bd/pa/PX89333_dfb7152f46ec52744f16d08f48a5c209.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-02-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PX89333%27 HTTP/1.1" 200 None
2026-03-28 12:11:28 [auto1.nl] INFO: Saving data for PX89333: {'created_time': 1774699888.173009, 'last_price_update_time': 1774699888.17302, 'auction_closing_time': 1774884485.0}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PX89333') HTTP/1.1" 204 0
2026-03-28 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-28 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702
2026-03-28 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ce22037-fda4-5392-8390-f9d4c00e222e with identifier: HK48702 to the API
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_9e1d07251960432729d9f5c4a92847b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:33:12Z',
 'fuel_type': 'petrol',
 'id': '3ce22037-fda4-5392-8390-f9d4c00e222e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '05ZRD4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK48702',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'Mazda',
 'model': '2',
 'odometer': 210752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_06c26f278e8150c50c0bbd2b56d429aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_3c02cf5a56285aa78c51e564d536e4fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_7679ea0024055c2dda11fb8bbec69e15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_bc918c162fcf63b6caa79186fbdc322e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ce22037-fda4-5392-8390-f9d4c00e222e/3ce22037-fda4-5392-8390-f9d4c00e222e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/d0/68d061b64562a6dad18e190f3e2134f5/pa/HK48702_9e1d07251960432729d9f5c4a92847b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.3 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK48702%27 HTTP/1.1" 200 None
2026-03-28 12:11:28 [auto1.nl] INFO: Saving data for HK48702: {'created_time': 1774699888.61163, 'last_price_update_time': 1774699888.61164, 'auction_closing_time': 1774884792.0}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK48702') HTTP/1.1" 204 0
2026-03-28 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-28 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466
2026-03-28 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d1502fa-b8b4-5d69-baf5-460e0b8a50c5 with identifier: YJ91466 to the API
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:07Z',
 'fuel_type': 'petrol',
 'id': '7d1502fa-b8b4-5d69-baf5-460e0b8a50c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ91466',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 285394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 839953,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_8d86b07d4dd9184eb830312f892ad64a.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_363f1aff99a74d51602ae4e835345ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_d909323f18850a212606a9d0d06f867f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_1205cbc523e32c249c5ec7249af19e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1565168,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_f973c88d3a30abf2568a37ee6102e079.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d1502fa-b8b4-5d69-baf5-460e0b8a50c5/7d1502fa-b8b4-5d69-baf5-460e0b8a50c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1b/36/1b3689f9162c81bba4d931076f006a45/pa/YJ91466_22a1494d4dddb167a01490682312161d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion',
 'year': 2010}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YJ91466%27 HTTP/1.1" 200 None
2026-03-28 12:11:28 [auto1.nl] INFO: Saving data for YJ91466: {'created_time': 1774699888.957934, 'last_price_update_time': 1774699888.957943, 'auction_closing_time': 1774886227.0}
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YJ91466') HTTP/1.1" 204 0
2026-03-28 12:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_51fd5faa942c1d101e05f26afa416ed7.jpg> (referer: https://www.auto1.com/)
2026-03-28 12:11:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 12:11:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f9139f54490>
2026-03-28 12:11:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 12:11:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_0.jpg HTTP/1.1" 201 0
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F24%252Fdc24eba58a416e4f99a5e0bd770c047f%252Fpa%252FGS42620_51fd5faa942c1d101e05f26afa416ed7.jpg') HTTP/1.1" 204 0
2026-03-28 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_51fd5faa942c1d101e05f26afa416ed7.jpg saved to cache
2026-03-28 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c929727d-ced9-597b-b6fe-4f982e0da845
2026-03-28 12:11:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c929727d-ced9-597b-b6fe-4f982e0da845, skipping ID generation
2026-03-28 12:11:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c929727d-ced9-597b-b6fe-4f982e0da845 with scrape type 1
2026-03-28 12:11:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c929727d-ced9-597b-b6fe-4f982e0da845 sending to next pipeline
2026-03-28 12:11:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c929727d-ced9-597b-b6fe-4f982e0da845, identifier: GS42620
2026-03-28 12:11:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-28 12:11:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620
2026-03-28 12:11:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c929727d-ced9-597b-b6fe-4f982e0da845 with identifier: GS42620 to the API
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_51fd5faa942c1d101e05f26afa416ed7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:15:18Z',
 'fuel_type': 'hybrid',
 'id': 'c929727d-ced9-597b-b6fe-4f982e0da845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS42620',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 152516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 963586,
             'Height': 1200,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_51fd5faa942c1d101e05f26afa416ed7.jpg',
             'Width': 1600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_b13b0540c56c386ae0d83eeb77fcf8e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_5362c101182d5af25b3805e1b961ec82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_0c2d8a99b89d2f124d614331f6a2c015.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c929727d-ced9-597b-b6fe-4f982e0da845/c929727d-ced9-597b-b6fe-4f982e0da845_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/24/dc24eba58a416e4f99a5e0bd770c047f/pa/GS42620_d07ba7c4e657ae780b62e0c9e624af74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS42620%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Saving data for GS42620: {'created_time': 1774699889.5698, 'last_price_update_time': 1774699889.56981, 'auction_closing_time': 1774883718.0}
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS42620') HTTP/1.1" 204 0
2026-03-28 12:11:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:29 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for DS66279: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for RS83136: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for PK22988: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for HL29308: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-28 12:11:29 [auto1.nl] INFO: Scrape type for DG66253: 0
2026-03-28 12:11:29 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for WL71666: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for BG13282: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for AT24375: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for MK53801: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for SV01425: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for NN10776: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for PD16289: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for AK38952: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for JR94083: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for GN78419: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for JN62257: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX80263%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for RX80263: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for GH52378: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for YZ87592: 0
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 12:11:30 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-28 12:11:30 [auto1.nl] INFO: Scrape type for TG63476: 0
2026-03-28 12:11:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:31 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for WJ55319: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for NA29712: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for RL27027: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for HL15145: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for JH65457: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for NG59138: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for RX87837: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for DG73581: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for TE69449: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-28 12:11:31 [auto1.nl] INFO: Scrape type for YR08683: 0
2026-03-28 12:11:31 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 12:11:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:33 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for LR97495: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for VT81070: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for AS78971: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for TN86188: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for PZ31508: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for DN23343: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for CP17463: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for EJ39658: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for AG27565: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for SX35832: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for RF26708: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for RV40948: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for CV80682: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for EP01312: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for BD71761: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for RD50492: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for UU65627: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for BX68417: 0
2026-03-28 12:11:33 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-28 12:11:33 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-28 12:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:34 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for NY95005: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for BY33770: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for YE36776: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE70578%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for TE70578: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-28 12:11:34 [auto1.nl] INFO: Scrape type for TS92650: 0
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 12:11:34 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for YW78376: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for SW41282: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for PZ22600: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for BN28689: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for MD57319: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for CK48888: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD99184%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for GD99184: 0
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 12:11:35 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-28 12:11:35 [auto1.nl] INFO: Scrape type for WV32142: 0
2026-03-28 12:11:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:36 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for WC97739: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for MC21923: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for AK82229: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for FD16016: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for NX54730: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for HZ22754: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for FC55354: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for UU92567: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for SD69435: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for LD75991: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for CL54405: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for CJ31369: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for MD55137: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE21436%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for ZE21436: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for TU57635: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for LJ77908: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for GS89780: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA86988%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for VA86988: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for XD32446: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for XB72700: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for AX44669: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for XV41758: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL80205%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for VL80205: 0
2026-03-28 12:11:36 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-28 12:11:36 [auto1.nl] INFO: Scrape type for PN49901: 0
2026-03-28 12:11:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:37 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for WA98443: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ08711%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for GJ08711: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for MR73967: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for TD05711: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for TV28211: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for NB61734: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for RP69884: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for BA16838: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS31744%27 HTTP/1.1" 200 None
2026-03-28 12:11:37 [auto1.nl] INFO: Scrape type for SS31744: 0
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 12:11:37 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for RM20026: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for MX87704: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for EH98197: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ35389%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for JZ35389: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HG56616%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for HG56616: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for MR89214: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for SG32295: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL48318%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for HL48318: 0
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 12:11:38 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-28 12:11:38 [auto1.nl] INFO: Scrape type for RC82380: 0
2026-03-28 12:11:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:39 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX28541%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for AX28541: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for KK31365: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22652%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for SV22652: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM97362%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for NM97362: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for LE78061: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for JL68792: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for UK83589: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for JM82020: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for RT17699: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63957%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for ZP63957: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for ZX00670: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS77626%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for NS77626: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for DA68002: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX15335%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for LX15335: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for KF13201: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for FJ04475: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM87332%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for NM87332: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN54197%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for MN54197: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for VW77077: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-28 12:11:39 [auto1.nl] INFO: Scrape type for JN17461: 0
2026-03-28 12:11:39 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 12:11:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:40 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for NS14796: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for BP47777: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for ER73656: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ96412%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for FJ96412: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16720%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for HT16720: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC91044%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for XC91044: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM13419%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for CM13419: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL78347%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for DL78347: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ17993%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for EJ17993: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD56899%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for FD56899: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW61305%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for AW61305: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL82021%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for NL82021: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD71224%27 HTTP/1.1" 200 None
2026-03-28 12:11:40 [auto1.nl] INFO: Scrape type for RD71224: 0
2026-03-28 12:11:40 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR11915%27 HTTP/1.1" 200 None
2026-03-28 12:11:41 [auto1.nl] INFO: Scrape type for CR11915: 0
2026-03-28 12:11:41 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV97350%27 HTTP/1.1" 200 None
2026-03-28 12:11:41 [auto1.nl] INFO: Scrape type for TV97350: 0
2026-03-28 12:11:41 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA20726%27 HTTP/1.1" 200 None
2026-03-28 12:11:41 [auto1.nl] INFO: Scrape type for BA20726: 0
2026-03-28 12:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:43 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT17806%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for YT17806: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY92282%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for SY92282: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY18740%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for UY18740: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW90615%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for XW90615: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE89486%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for PE89486: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE73966%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for SE73966: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB30302%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for BB30302: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM31499%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for EM31499: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU03556%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for CU03556: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB53809%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for UB53809: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL89699%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for HL89699: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR73964%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for FR73964: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY94157%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for BY94157: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AP41268%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for AP41268: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VP87797%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for VP87797: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS74153%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for NS74153: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV84229%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for GV84229: 0
2026-03-28 12:11:43 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN84532%27 HTTP/1.1" 200 None
2026-03-28 12:11:43 [auto1.nl] INFO: Scrape type for NN84532: 0
2026-03-28 12:11:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:45 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE34591%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for YE34591: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ65940%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for FZ65940: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ92310%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for GJ92310: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB31523%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for FB31523: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV87922%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for KV87922: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN23461%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for BN23461: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB11708%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for DB11708: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA39376%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for NA39376: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR80776%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for AR80776: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY93062%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for PY93062: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD48612%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for DD48612: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM00428%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for CM00428: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW55830%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for TW55830: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59991%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for HH59991: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW39949%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for FW39949: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR99157%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for UR99157: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM07460%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for AM07460: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ50492%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for MZ50492: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY58487%27 HTTP/1.1" 200 None
2026-03-28 12:11:45 [auto1.nl] INFO: Scrape type for JY58487: 0
2026-03-28 12:11:45 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 12:11:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:46 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP69601%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for NP69601: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC58225%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for HC58225: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU12203%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for VU12203: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR49127%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for YR49127: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL63517%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for FL63517: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR15886%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for NR15886: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN75862%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for WN75862: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN82428%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for PN82428: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD17412%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for HD17412: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH64896%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for EH64896: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC84495%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for AC84495: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD36085%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for KD36085: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP95967%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for WP95967: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ05110%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for UJ05110: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN89359%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for GN89359: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL29526%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for EL29526: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR65933%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for LR65933: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE00434%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for WE00434: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ87293%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for SZ87293: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK48987%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for FK48987: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX76865%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for NX76865: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM08260%27 HTTP/1.1" 200 None
2026-03-28 12:11:46 [auto1.nl] INFO: Scrape type for SM08260: 0
2026-03-28 12:11:46 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 12:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:47 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN05115%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for GN05115: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY75066%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for RY75066: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ42388%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for AZ42388: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP12059%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for ZP12059: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY58020%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for EY58020: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA79399%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for SA79399: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF47261%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for RF47261: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY07410%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for BY07410: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ40216%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for KZ40216: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD19679%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for VD19679: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ85660%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for FZ85660: 0
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 12:11:47 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-28 12:11:47 [auto1.nl] INFO: Scrape type for VM41876: 2
2026-03-28 12:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-28 12:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af47009-9baf-5d8b-8363-fd8d084171a4 with scrape type 2
2026-03-28 12:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7af47009-9baf-5d8b-8363-fd8d084171a4 with scrape type 2
2026-03-28 12:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7af47009-9baf-5d8b-8363-fd8d084171a4, identifier: VM41876
2026-03-28 12:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-28 12:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-28 12:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876 to the API
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '7af47009-9baf-5d8b-8363-fd8d084171a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM41876',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 109195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-28 12:11:48 [auto1.nl] INFO: Saving data for VM41876: {'auction_closing_time': 1774715601.0, 'created_time': 1774613424.217106, 'last_price_update_time': 1774699908.529903}
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM41876') HTTP/1.1" 204 0
2026-03-28 12:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:48 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 12:11:48 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-28 12:11:48 [auto1.nl] INFO: Scrape type for CP77095: 2
2026-03-28 12:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-28 12:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f25db6-ecfa-58fb-937a-bac29060adc3 with scrape type 2
2026-03-28 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40f25db6-ecfa-58fb-937a-bac29060adc3 with scrape type 2
2026-03-28 12:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40f25db6-ecfa-58fb-937a-bac29060adc3, identifier: CP77095
2026-03-28 12:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-28 12:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-28 12:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095 to the API
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'petrol',
 'id': '40f25db6-ecfa-58fb-937a-bac29060adc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP77095',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 36765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-28 12:11:48 [auto1.nl] INFO: Saving data for CP77095: {'auction_closing_time': 1774714296.0, 'created_time': 1774613425.507735, 'last_price_update_time': 1774699908.989238}
2026-03-28 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP77095') HTTP/1.1" 204 0
2026-03-28 12:11:49 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-28 12:11:49 [auto1.nl] INFO: Scrape type for YZ85937: 2
2026-03-28 12:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-28 12:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 2
2026-03-28 12:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 2
2026-03-28 12:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a4119aee-b299-554e-a3e1-8b46b6b38066, identifier: YZ85937
2026-03-28 12:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-28 12:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-28 12:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937 to the API
2026-03-28 12:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 113,
 'expiration_date': '2026-03-28T16:34:16Z',
 'fuel_type': 'petrol',
 'id': 'a4119aee-b299-554e-a3e1-8b46b6b38066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ85937',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-05',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Sportway',
 'transmission': 'manual',
 'trim': 'Sportway',
 'year': 2006}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Saving data for YZ85937: {'auction_closing_time': 1774715656.0, 'created_time': 1774613435.854893, 'last_price_update_time': 1774699910.118166}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ85937') HTTP/1.1" 204 0
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Scrape type for AB34968: 2
2026-03-28 12:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-28 12:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1466d57b-48fb-5f7c-bf02-89823f4e64b8, identifier: AB34968
2026-03-28 12:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-28 12:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-28 12:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968 to the API
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:18Z',
 'fuel_type': 'petrol',
 'id': '1466d57b-48fb-5f7c-bf02-89823f4e64b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB34968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 211460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Saving data for AB34968: {'auction_closing_time': 1774713918.0, 'created_time': 1774613435.096347, 'last_price_update_time': 1774699910.487422}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB34968') HTTP/1.1" 204 0
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Scrape type for VB96147: 2
2026-03-28 12:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-28 12:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2, identifier: VB96147
2026-03-28 12:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-28 12:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-28 12:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147 to the API
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:48Z',
 'fuel_type': 'petrol',
 'id': '155d186a-c2a1-57fd-8f5b-08aefda5e6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96147',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 200922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-02',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Saving data for VB96147: {'auction_closing_time': 1774714008.0, 'created_time': 1774613431.46133, 'last_price_update_time': 1774699910.853498}
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB96147') HTTP/1.1" 204 0
2026-03-28 12:11:50 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-28 12:11:50 [auto1.nl] INFO: Scrape type for WW80908: 2
2026-03-28 12:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-28 12:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-28 12:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4160835d-5ef4-5a94-b15c-6729c011c026, identifier: WW80908
2026-03-28 12:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-28 12:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-28 12:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908 to the API
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:29:12Z',
 'fuel_type': 'petrol',
 'id': '4160835d-5ef4-5a94-b15c-6729c011c026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW80908',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-28 12:11:51 [auto1.nl] INFO: Saving data for WW80908: {'auction_closing_time': 1774715352.0, 'created_time': 1773924229.472728, 'last_price_update_time': 1774699911.226679}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WW80908') HTTP/1.1" 204 0
2026-03-28 12:11:51 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-28 12:11:51 [auto1.nl] INFO: Scrape type for HA14742: 2
2026-03-28 12:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-28 12:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218c6b3-850a-55af-b95d-11797d99af57 with scrape type 2
2026-03-28 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7218c6b3-850a-55af-b95d-11797d99af57 with scrape type 2
2026-03-28 12:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7218c6b3-850a-55af-b95d-11797d99af57, identifier: HA14742
2026-03-28 12:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-28 12:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-28 12:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742 to the API
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:29:41Z',
 'fuel_type': 'petrol',
 'id': '7218c6b3-850a-55af-b95d-11797d99af57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA14742',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 16164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2013}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-28 12:11:51 [auto1.nl] INFO: Saving data for HA14742: {'auction_closing_time': 1774715381.0, 'created_time': 1774613446.732619, 'last_price_update_time': 1774699911.588062}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HA14742') HTTP/1.1" 204 0
2026-03-28 12:11:51 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 12:11:51 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-28 12:11:51 [auto1.nl] INFO: Scrape type for JD39017: 2
2026-03-28 12:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-28 12:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e with scrape type 2
2026-03-28 12:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e with scrape type 2
2026-03-28 12:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46c1323-b991-57d9-81ae-bd78bb9d4c4e, identifier: JD39017
2026-03-28 12:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-28 12:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-28 12:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017 to the API
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:00:43Z',
 'fuel_type': 'petrol',
 'id': 'c46c1323-b991-57d9-81ae-bd78bb9d4c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD39017',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 92866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2012}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-28 12:11:51 [auto1.nl] INFO: Saving data for JD39017: {'auction_closing_time': 1774713643.0, 'created_time': 1774613445.570664, 'last_price_update_time': 1774699911.955401}
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JD39017') HTTP/1.1" 204 0
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-28 12:11:52 [auto1.nl] INFO: Scrape type for TH29476: 2
2026-03-28 12:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-28 12:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4, identifier: TH29476
2026-03-28 12:11:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-28 12:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-28 12:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476 to the API
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:02:15Z',
 'fuel_type': 'electro',
 'id': '46b19869-6a66-5fe2-9ed7-a7e0960a78b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH29476',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 163460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2022}
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-28 12:11:52 [auto1.nl] INFO: Saving data for TH29476: {'auction_closing_time': 1774713735.0, 'created_time': 1773947569.529077, 'last_price_update_time': 1774699912.455125}
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH29476') HTTP/1.1" 204 0
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-28 12:11:52 [auto1.nl] INFO: Scrape type for GG02103: 2
2026-03-28 12:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-28 12:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e2408e1-db1c-55b2-9b47-89752902d7d2, identifier: GG02103
2026-03-28 12:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-28 12:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-28 12:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103 to the API
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:09Z',
 'fuel_type': 'petrol',
 'id': '4e2408e1-db1c-55b2-9b47-89752902d7d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG02103',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 181472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-28 12:11:52 [auto1.nl] INFO: Saving data for GG02103: {'auction_closing_time': 1774714869.0, 'created_time': 1774613432.791702, 'last_price_update_time': 1774699912.835569}
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG02103') HTTP/1.1" 204 0
2026-03-28 12:11:52 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1045 | hits on page: 40
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 12:11:52 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-28 12:11:52 [auto1.nl] INFO: Scrape type for PY55457: 2
2026-03-28 12:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-28 12:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with scrape type 2
2026-03-28 12:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2, identifier: PY55457
2026-03-28 12:11:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-28 12:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-28 12:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457 to the API
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'petrol',
 'id': 'f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY55457',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 208379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-05',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-28 12:11:53 [auto1.nl] INFO: Saving data for PY55457: {'auction_closing_time': 1774714484.0, 'created_time': 1774613459.460172, 'last_price_update_time': 1774699913.227293}
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY55457') HTTP/1.1" 204 0
2026-03-28 12:11:53 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 12:11:53 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 12:11:53 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 12:11:53 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-28 12:11:53 [auto1.nl] INFO: Scrape type for GB17984: 2
2026-03-28 12:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-28 12:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 368c6d61-4cbf-56f1-b99f-55218d9b4180 with scrape type 2
2026-03-28 12:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 368c6d61-4cbf-56f1-b99f-55218d9b4180 with scrape type 2
2026-03-28 12:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 368c6d61-4cbf-56f1-b99f-55218d9b4180, identifier: GB17984
2026-03-28 12:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-28 12:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-28 12:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984 to the API
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:52:58Z',
 'fuel_type': 'petrol',
 'id': '368c6d61-4cbf-56f1-b99f-55218d9b4180',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB17984',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 97414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-28 12:11:53 [auto1.nl] INFO: Saving data for GB17984: {'auction_closing_time': 1774716778.0, 'created_time': 1774120272.687396, 'last_price_update_time': 1774699913.611719}
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB17984') HTTP/1.1" 204 0
2026-03-28 12:11:53 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-28 12:11:53 [auto1.nl] INFO: Scrape type for LH77043: 2
2026-03-28 12:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-28 12:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f3583f6-dcea-5498-a04b-38b00a571276 with scrape type 2
2026-03-28 12:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f3583f6-dcea-5498-a04b-38b00a571276 with scrape type 2
2026-03-28 12:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f3583f6-dcea-5498-a04b-38b00a571276, identifier: LH77043
2026-03-28 12:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-28 12:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-28 12:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043 to the API
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:13:02Z',
 'fuel_type': 'electro',
 'id': '8f3583f6-dcea-5498-a04b-38b00a571276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH77043',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 65903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-28',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 107 kW Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2022}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Saving data for LH77043: {'auction_closing_time': 1774714382.0, 'created_time': 1774613432.075512, 'last_price_update_time': 1774699914.059311}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH77043') HTTP/1.1" 204 0
2026-03-28 12:11:54 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 12:11:54 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Scrape type for HS59030: 2
2026-03-28 12:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-28 12:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb43248-629f-55e6-a122-9c46dc967f13 with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb43248-629f-55e6-a122-9c46dc967f13 with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bb43248-629f-55e6-a122-9c46dc967f13, identifier: HS59030
2026-03-28 12:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-28 12:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-28 12:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030 to the API
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:08:43Z',
 'fuel_type': 'electro',
 'id': '4bb43248-629f-55e6-a122-9c46dc967f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS59030',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 143250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus RWD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Saving data for HS59030: {'auction_closing_time': 1774714123.0, 'created_time': 1774613429.392344, 'last_price_update_time': 1774699914.494178}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS59030') HTTP/1.1" 204 0
2026-03-28 12:11:54 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 12:11:54 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Scrape type for AV01442: 2
2026-03-28 12:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-28 12:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 41cbe5b7-07ae-5371-b437-fdcd213bcadc, identifier: AV01442
2026-03-28 12:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-28 12:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-28 12:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442 to the API
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:36:59Z',
 'fuel_type': 'electro',
 'id': '41cbe5b7-07ae-5371-b437-fdcd213bcadc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV01442',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'EQB',
 'odometer': 53482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-28',
 'seller_name': None,
 'title': 'Mercedes-Benz EQB 250 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Saving data for AV01442: {'auction_closing_time': 1774715819.0, 'created_time': 1774613429.99159, 'last_price_update_time': 1774699914.858832}
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV01442') HTTP/1.1" 204 0
2026-03-28 12:11:54 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-28 12:11:54 [auto1.nl] INFO: Scrape type for FC64695: 2
2026-03-28 12:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-28 12:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 2
2026-03-28 12:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b440c16f-9729-50c4-b006-0c0325ae9f89, identifier: FC64695
2026-03-28 12:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-28 12:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-28 12:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695 to the API
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:28Z',
 'fuel_type': 'petrol',
 'id': 'b440c16f-9729-50c4-b006-0c0325ae9f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC64695',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 185857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-16',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Saving data for FC64695: {'auction_closing_time': 1774714288.0, 'created_time': 1774613450.447302, 'last_price_update_time': 1774699915.227671}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC64695') HTTP/1.1" 204 0
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Scrape type for RC74760: 2
2026-03-28 12:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-28 12:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 2
2026-03-28 12:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 2
2026-03-28 12:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6075b79-10fa-5ce8-a74f-84de841b9f57, identifier: RC74760
2026-03-28 12:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-28 12:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-28 12:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760 to the API
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:47Z',
 'fuel_type': 'petrol',
 'id': 'e6075b79-10fa-5ce8-a74f-84de841b9f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74760',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-13',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Saving data for RC74760: {'auction_closing_time': 1774716467.0, 'created_time': 1774613433.421632, 'last_price_update_time': 1774699915.589699}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74760') HTTP/1.1" 204 0
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Scrape type for BU15419: 2
2026-03-28 12:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-28 12:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c076bccc-b1c9-5648-ba84-ce5655f6a574 with scrape type 2
2026-03-28 12:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c076bccc-b1c9-5648-ba84-ce5655f6a574 with scrape type 2
2026-03-28 12:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c076bccc-b1c9-5648-ba84-ce5655f6a574, identifier: BU15419
2026-03-28 12:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-28 12:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-28 12:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419 to the API
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:10Z',
 'fuel_type': 'petrol',
 'id': 'c076bccc-b1c9-5648-ba84-ce5655f6a574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU15419',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 239367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2017}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Saving data for BU15419: {'auction_closing_time': 1774716730.0, 'created_time': 1774613437.263285, 'last_price_update_time': 1774699915.956443}
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU15419') HTTP/1.1" 204 0
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 12:11:55 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-28 12:11:55 [auto1.nl] INFO: Scrape type for ST70882: 2
2026-03-28 12:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-28 12:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with scrape type 2
2026-03-28 12:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with scrape type 2
2026-03-28 12:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4cf93ee-ae4b-5a94-a142-2495a0f3d548, identifier: ST70882
2026-03-28 12:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-28 12:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-28 12:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882 to the API
2026-03-28 12:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:07:36Z',
 'fuel_type': 'petrol',
 'id': 'e4cf93ee-ae4b-5a94-a142-2495a0f3d548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST70882',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 88984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-06-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Initiale Matic',
 'transmission': 'automatic',
 'trim': 'Initiale Matic',
 'year': 2000}
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-28 12:11:57 [auto1.nl] INFO: Saving data for ST70882: {'auction_closing_time': 1774714056.0, 'created_time': 1774613443.186935, 'last_price_update_time': 1774699917.137476}
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ST70882') HTTP/1.1" 204 0
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-28 12:11:57 [auto1.nl] INFO: Scrape type for ZZ76935: 2
2026-03-28 12:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-28 12:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with scrape type 2
2026-03-28 12:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with scrape type 2
2026-03-28 12:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf, identifier: ZZ76935
2026-03-28 12:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-28 12:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-28 12:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935 to the API
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:25Z',
 'fuel_type': 'petrol',
 'id': 'de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ76935',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 220382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-27',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2008}
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-28 12:11:57 [auto1.nl] INFO: Saving data for ZZ76935: {'auction_closing_time': 1774713985.0, 'created_time': 1774613468.483994, 'last_price_update_time': 1774699917.636904}
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ76935') HTTP/1.1" 204 0
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 12:11:57 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-28 12:11:57 [auto1.nl] INFO: Scrape type for DZ37745: 2
2026-03-28 12:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-28 12:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with scrape type 2
2026-03-28 12:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with scrape type 2
2026-03-28 12:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa, identifier: DZ37745
2026-03-28 12:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-28 12:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-28 12:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745 to the API
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:31:20Z',
 'fuel_type': 'petrol',
 'id': '74565cf4-5b98-5bc4-9483-e63f6ecdc4fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ37745',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-16',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Saving data for DZ37745: {'auction_closing_time': 1774715480.0, 'created_time': 1774613451.079042, 'last_price_update_time': 1774699918.018124}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DZ37745') HTTP/1.1" 204 0
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Scrape type for BU16200: 2
2026-03-28 12:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-28 12:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81, identifier: BU16200
2026-03-28 12:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-28 12:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-28 12:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200 to the API
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': 'a1d476b6-ca15-5b1b-b633-eafb1a6a0d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16200',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 25962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
 'transmission': 'automatic',
 'trim': 'Titanium Business',
 'year': 2019}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Saving data for BU16200: {'auction_closing_time': 1774715238.0, 'created_time': 1774613474.66408, 'last_price_update_time': 1774699918.409053}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU16200') HTTP/1.1" 204 0
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Scrape type for NX47084: 2
2026-03-28 12:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-28 12:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4, identifier: NX47084
2026-03-28 12:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-28 12:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-28 12:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084 to the API
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:45:54Z',
 'fuel_type': 'hybrid',
 'id': 'a95d0e9f-f0c3-5ef4-ae63-03595406ccf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX47084',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 196479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Saving data for NX47084: {'auction_closing_time': 1774716354.0, 'created_time': 1773134904.784466, 'last_price_update_time': 1774699918.787317}
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX47084') HTTP/1.1" 204 0
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 12:11:58 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-28 12:11:58 [auto1.nl] INFO: Scrape type for SY53039: 2
2026-03-28 12:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-28 12:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 2
2026-03-28 12:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ae6fc4-df0c-537e-bfeb-79779142b37c, identifier: SY53039
2026-03-28 12:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-28 12:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-28 12:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039 to the API
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:26:52Z',
 'fuel_type': 'diesel',
 'id': '02ae6fc4-df0c-537e-bfeb-79779142b37c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY53039',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV250',
 'odometer': 190282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seller_name': None,
 'title': 'Nissan NV250 1.5 dCi L1H1 2,0t Comfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,0t Comfort',
 'year': 2019}
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-28 12:11:59 [auto1.nl] INFO: Saving data for SY53039: {'auction_closing_time': 1774715212.0, 'created_time': 1774613447.733057, 'last_price_update_time': 1774699919.161252}
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY53039') HTTP/1.1" 204 0
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-28 12:11:59 [auto1.nl] INFO: Scrape type for AW03238: 2
2026-03-28 12:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-28 12:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e116a5-0554-5516-8d57-194c4017972d with scrape type 2
2026-03-28 12:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e116a5-0554-5516-8d57-194c4017972d with scrape type 2
2026-03-28 12:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 70e116a5-0554-5516-8d57-194c4017972d, identifier: AW03238
2026-03-28 12:11:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-28 12:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-28 12:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238 to the API
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:44Z',
 'fuel_type': 'petrol',
 'id': '70e116a5-0554-5516-8d57-194c4017972d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW03238',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Caliber',
 'odometer': 201846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-16',
 'seller_name': None,
 'title': 'Dodge Caliber 1.8 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2009}
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-28 12:11:59 [auto1.nl] INFO: Saving data for AW03238: {'auction_closing_time': 1774717124.0, 'created_time': 1773924406.790854, 'last_price_update_time': 1774699919.673268}
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW03238') HTTP/1.1" 204 0
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 12:11:59 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-28 12:11:59 [auto1.nl] INFO: Scrape type for YN37403: 2
2026-03-28 12:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-28 12:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-28 12:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-28 12:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73656187-f35a-5ed4-b942-7a3c94b60356, identifier: YN37403
2026-03-28 12:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-28 12:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-28 12:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403 to the API
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:15:55Z',
 'fuel_type': 'petrol',
 'id': '73656187-f35a-5ed4-b942-7a3c94b60356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN37403',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 155561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Saving data for YN37403: {'auction_closing_time': 1774714555.0, 'created_time': 1773688652.373443, 'last_price_update_time': 1774699920.045189}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN37403') HTTP/1.1" 204 0
2026-03-28 12:12:00 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 12:12:00 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1045 | hits on page: 40
2026-03-28 12:12:00 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 12:12:00 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Scrape type for GN83420: 2
2026-03-28 12:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-28 12:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with scrape type 2
2026-03-28 12:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with scrape type 2
2026-03-28 12:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49715ebb-1a83-5042-b7d1-86a59d60b4e0, identifier: GN83420
2026-03-28 12:12:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-28 12:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-28 12:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420 to the API
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:52:55Z',
 'fuel_type': 'petrol',
 'id': '49715ebb-1a83-5042-b7d1-86a59d60b4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN83420',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 112755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Saving data for GN83420: {'auction_closing_time': 1774716775.0, 'created_time': 1774613449.383712, 'last_price_update_time': 1774699920.451589}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN83420') HTTP/1.1" 204 0
2026-03-28 12:12:00 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Scrape type for BW44039: 2
2026-03-28 12:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-28 12:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3617601c-acda-5ab6-882a-3a2097aee563 with scrape type 2
2026-03-28 12:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3617601c-acda-5ab6-882a-3a2097aee563 with scrape type 2
2026-03-28 12:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3617601c-acda-5ab6-882a-3a2097aee563, identifier: BW44039
2026-03-28 12:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-28 12:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-28 12:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039 to the API
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:16:47Z',
 'fuel_type': 'hybrid',
 'id': '3617601c-acda-5ab6-882a-3a2097aee563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW44039',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 152250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Saving data for BW44039: {'auction_closing_time': 1774714607.0, 'created_time': 1774613441.406467, 'last_price_update_time': 1774699920.822633}
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW44039') HTTP/1.1" 204 0
2026-03-28 12:12:00 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-28 12:12:00 [auto1.nl] INFO: Scrape type for FK86795: 2
2026-03-28 12:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-28 12:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f2004a-6343-513b-88d3-4472beba9358 with scrape type 2
2026-03-28 12:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f2004a-6343-513b-88d3-4472beba9358 with scrape type 2
2026-03-28 12:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03f2004a-6343-513b-88d3-4472beba9358, identifier: FK86795
2026-03-28 12:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-28 12:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-28 12:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795 to the API
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:34:26Z',
 'fuel_type': 'petrol',
 'id': '03f2004a-6343-513b-88d3-4472beba9358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK86795',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 161711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-28 12:12:01 [auto1.nl] INFO: Saving data for FK86795: {'auction_closing_time': 1774715666.0, 'created_time': 1773775072.600569, 'last_price_update_time': 1774699921.321411}
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK86795') HTTP/1.1" 204 0
2026-03-28 12:12:01 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 12:12:01 [auto1.nl] INFO: Scrape type for NV18219: 2
2026-03-28 12:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-28 12:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 2
2026-03-28 12:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 2
2026-03-28 12:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2c29d93-16a6-508a-9123-64321ec59c9a, identifier: NV18219
2026-03-28 12:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-28 12:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-28 12:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219 to the API
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:58:35Z',
 'fuel_type': 'petrol',
 'id': 'f2c29d93-16a6-508a-9123-64321ec59c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV18219',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 220479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-26',
 'seller_name': None,
 'title': 'BMW X3 3.0i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-28 12:12:01 [auto1.nl] INFO: Saving data for NV18219: {'auction_closing_time': 1774717115.0, 'created_time': 1774613443.547074, 'last_price_update_time': 1774699921.70075}
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV18219') HTTP/1.1" 204 0
2026-03-28 12:12:01 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 12:12:01 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-28 12:12:01 [auto1.nl] INFO: Scrape type for NL65263: 2
2026-03-28 12:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-28 12:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcaeb174-da19-5334-a362-ae689b907208 with scrape type 2
2026-03-28 12:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcaeb174-da19-5334-a362-ae689b907208 with scrape type 2
2026-03-28 12:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dcaeb174-da19-5334-a362-ae689b907208, identifier: NL65263
2026-03-28 12:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-28 12:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-28 12:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263 to the API
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:23:53Z',
 'fuel_type': 'petrol',
 'id': 'dcaeb174-da19-5334-a362-ae689b907208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL65263',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 211385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Saving data for NL65263: {'auction_closing_time': 1774715033.0, 'created_time': 1773774970.164832, 'last_price_update_time': 1774699922.085233}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL65263') HTTP/1.1" 204 0
2026-03-28 12:12:02 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 12:12:02 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Scrape type for ZL62057: 2
2026-03-28 12:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-28 12:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e, identifier: ZL62057
2026-03-28 12:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-28 12:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-28 12:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057 to the API
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'diesel',
 'id': '1afbdb8d-f03b-51dd-a3be-995c93e4d14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL62057',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 202812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Opel Combo 1.3 CDTI Kasten L1H1 2,2t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,2t',
 'year': 2017}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Saving data for ZL62057: {'auction_closing_time': 1774713704.0, 'created_time': 1773774967.694041, 'last_price_update_time': 1774699922.461268}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL62057') HTTP/1.1" 204 0
2026-03-28 12:12:02 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Scrape type for PA07201: 2
2026-03-28 12:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-28 12:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82a1fc8-55b0-54f1-b687-49855322d40e with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c82a1fc8-55b0-54f1-b687-49855322d40e with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c82a1fc8-55b0-54f1-b687-49855322d40e, identifier: PA07201
2026-03-28 12:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-28 12:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-28 12:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201 to the API
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:57:49Z',
 'fuel_type': 'petrol',
 'id': 'c82a1fc8-55b0-54f1-b687-49855322d40e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA07201',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 152113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2005}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Saving data for PA07201: {'auction_closing_time': 1774717069.0, 'created_time': 1774613444.852499, 'last_price_update_time': 1774699922.843097}
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA07201') HTTP/1.1" 204 0
2026-03-28 12:12:02 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-28 12:12:02 [auto1.nl] INFO: Scrape type for WU34213: 2
2026-03-28 12:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-28 12:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77737d54-e208-58bd-b23d-d89e6e2f3656 with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77737d54-e208-58bd-b23d-d89e6e2f3656 with scrape type 2
2026-03-28 12:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77737d54-e208-58bd-b23d-d89e6e2f3656, identifier: WU34213
2026-03-28 12:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-28 12:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 12:12:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 12:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-28 12:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213 to the API
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:09:38Z',
 'fuel_type': 'petrol',
 'id': '77737d54-e208-58bd-b23d-d89e6e2f3656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU34213',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 218656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-28',
 'seller_name': None,
 'title': 'Volkswagen Passat CC 1.8 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-28 12:12:03 [auto1.nl] INFO: Saving data for WU34213: {'auction_closing_time': 1774714178.0, 'created_time': 1774613468.031922, 'last_price_update_time': 1774699923.373253}
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU34213') HTTP/1.1" 204 0
2026-03-28 12:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:12:03 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-28 12:12:03 [auto1.nl] INFO: Scrape type for GP63449: 2
2026-03-28 12:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-28 12:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e334de-e05e-58a4-a382-d478bd0810e7 with scrape type 2
2026-03-28 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e334de-e05e-58a4-a382-d478bd0810e7 with scrape type 2
2026-03-28 12:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 22e334de-e05e-58a4-a382-d478bd0810e7, identifier: GP63449
2026-03-28 12:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-28 12:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-28 12:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449 to the API
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:40:50Z',
 'fuel_type': 'hybrid',
 'id': '22e334de-e05e-58a4-a382-d478bd0810e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP63449',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 250449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-30',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2013}
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-28 12:12:03 [auto1.nl] INFO: Saving data for GP63449: {'auction_closing_time': 1774716050.0, 'created_time': 1774613447.070463, 'last_price_update_time': 1774699923.774364}
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP63449') HTTP/1.1" 204 0
2026-03-28 12:12:03 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-28 12:12:03 [auto1.nl] INFO: Scrape type for FK39304: 2
2026-03-28 12:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-28 12:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 2
2026-03-28 12:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 2
2026-03-28 12:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aaeb7602-4138-550e-88fa-de8627c49056, identifier: FK39304
2026-03-28 12:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-28 12:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-28 12:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304 to the API
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:16Z',
 'fuel_type': 'petrol',
 'id': 'aaeb7602-4138-550e-88fa-de8627c49056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK39304',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 82466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-15',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-28 12:12:04 [auto1.nl] INFO: Saving data for FK39304: {'auction_closing_time': 1774714516.0, 'created_time': 1774613444.282703, 'last_price_update_time': 1774699924.204112}
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK39304') HTTP/1.1" 204 0
2026-03-28 12:12:04 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1045 | hits on page: 40
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-28 12:12:04 [auto1.nl] INFO: Scrape type for TC15988: 2
2026-03-28 12:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-28 12:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd61cbb9-f227-5599-9f83-2942b52c0271 with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd61cbb9-f227-5599-9f83-2942b52c0271 with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd61cbb9-f227-5599-9f83-2942b52c0271, identifier: TC15988
2026-03-28 12:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-28 12:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-28 12:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988 to the API
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:09:41Z',
 'fuel_type': 'hybrid',
 'id': 'cd61cbb9-f227-5599-9f83-2942b52c0271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC15988',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 129745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-28 12:12:04 [auto1.nl] INFO: Saving data for TC15988: {'auction_closing_time': 1774714181.0, 'created_time': 1774613438.55577, 'last_price_update_time': 1774699924.588015}
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC15988') HTTP/1.1" 204 0
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-28 12:12:04 [auto1.nl] INFO: Scrape type for PA43644: 2
2026-03-28 12:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-28 12:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705, identifier: PA43644
2026-03-28 12:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 12:12:04 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-28 12:12:04 [auto1.nl] INFO: Scrape type for WK29789: 2
2026-03-28 12:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-28 12:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-28 12:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6817a3df-020f-50e7-bb25-2b9bd824fefb, identifier: WK29789
2026-03-28 12:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-28 12:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-28 12:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644 to the API
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:27:19Z',
 'fuel_type': 'hybrid',
 'id': '3c1ae3d0-e1ec-52cb-893e-61e62c7d3705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA43644',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 32375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Intuitive 2WD',
 'transmission': 'automatic',
 'trim': 'Intuitive 2WD',
 'year': 2023}
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-28 12:12:05 [auto1.nl] INFO: Saving data for PA43644: {'auction_closing_time': 1774715239.0, 'created_time': 1773229580.841529, 'last_price_update_time': 1774699925.209696}
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA43644') HTTP/1.1" 204 0
2026-03-28 12:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-28 12:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-28 12:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789 to the API
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:40Z',
 'fuel_type': 'petrol',
 'id': '6817a3df-020f-50e7-bb25-2b9bd824fefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK29789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 143827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-28 12:12:05 [auto1.nl] INFO: Saving data for WK29789: {'auction_closing_time': 1774715380.0, 'created_time': 1773688299.871507, 'last_price_update_time': 1774699925.488999}
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK29789') HTTP/1.1" 204 0
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-28 12:12:05 [auto1.nl] INFO: Scrape type for NT33284: 2
2026-03-28 12:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-28 12:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-28 12:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-28 12:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af, identifier: NT33284
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 12:12:05 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-28 12:12:05 [auto1.nl] INFO: Scrape type for YH72796: 2
2026-03-28 12:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-28 12:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-28 12:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-28 12:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57d93af0-67d8-55f9-ae0a-201b49f43387, identifier: YH72796
2026-03-28 12:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-28 12:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-28 12:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284 to the API
2026-03-28 12:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': '65cd3790-8e0e-5c15-9d8e-519de9b0a4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT33284',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 111701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-28 12:12:06 [auto1.nl] INFO: Saving data for NT33284: {'auction_closing_time': 1774715123.0, 'created_time': 1773688667.240473, 'last_price_update_time': 1774699926.268058}
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT33284') HTTP/1.1" 204 0
2026-03-28 12:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-28 12:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-28 12:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796 to the API
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'hybrid',
 'id': '57d93af0-67d8-55f9-ae0a-201b49f43387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 208636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e Lounge Plus',
 'transmission': 'automatic',
 'trim': 'Lounge Plus',
 'year': 2017}
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-28 12:12:06 [auto1.nl] INFO: Saving data for YH72796: {'auction_closing_time': 1774714893.0, 'created_time': 1773861304.855617, 'last_price_update_time': 1774699926.632053}
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YH72796') HTTP/1.1" 204 0
2026-03-28 12:12:06 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-28 12:12:06 [auto1.nl] INFO: Scrape type for AX77318: 2
2026-03-28 12:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-28 12:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36018dc-477d-588c-b069-15495730ef95 with scrape type 2
2026-03-28 12:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36018dc-477d-588c-b069-15495730ef95 with scrape type 2
2026-03-28 12:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e36018dc-477d-588c-b069-15495730ef95, identifier: AX77318
2026-03-28 12:12:06 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-28 12:12:06 [auto1.nl] INFO: Scrape type for FE21861: 2
2026-03-28 12:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-28 12:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-28 12:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-28 12:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055, identifier: FE21861
2026-03-28 12:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-28 12:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-28 12:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318 to the API
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:27:29Z',
 'fuel_type': 'petrol',
 'id': 'e36018dc-477d-588c-b069-15495730ef95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX77318',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 92848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-03',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-28 12:12:07 [auto1.nl] INFO: Saving data for AX77318: {'auction_closing_time': 1774715249.0, 'created_time': 1774465827.65284, 'last_price_update_time': 1774699927.102354}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX77318') HTTP/1.1" 204 0
2026-03-28 12:12:07 [scrapy.extensions.logstats] INFO: Crawled 139 pages (at 45 pages/min), scraped 106 items (at 63 items/min)
2026-03-28 12:12:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 12:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-28 12:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-28 12:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861 to the API
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:15:40Z',
 'fuel_type': 'hybrid',
 'id': '1ed2ca5e-b39d-52ec-811e-1f4acb82e055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE21861',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 149076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'BMW 5er 530e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-28 12:12:07 [auto1.nl] INFO: Saving data for FE21861: {'auction_closing_time': 1774714540.0, 'created_time': 1773774764.56175, 'last_price_update_time': 1774699927.396121}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE21861') HTTP/1.1" 204 0
2026-03-28 12:12:07 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 12:12:07 [auto1.nl] INFO: Scrape type for FR61201: 2
2026-03-28 12:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-28 12:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-28 12:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-28 12:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89c28401-a63c-572a-a6f8-20b7567a2d9c, identifier: FR61201
2026-03-28 12:12:07 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-28 12:12:07 [auto1.nl] INFO: Scrape type for SV00912: 2
2026-03-28 12:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-28 12:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-28 12:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-28 12:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7102d58d-8e12-51ba-90bf-5b632bc53acf, identifier: SV00912
2026-03-28 12:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-28 12:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-28 12:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201 to the API
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:56:21Z',
 'fuel_type': 'petrol',
 'id': '89c28401-a63c-572a-a6f8-20b7567a2d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR61201',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 145022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-28 12:12:07 [auto1.nl] INFO: Saving data for FR61201: {'auction_closing_time': 1774716981.0, 'created_time': 1773302367.371782, 'last_price_update_time': 1774699927.911236}
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR61201') HTTP/1.1" 204 0
2026-03-28 12:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-28 12:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-28 12:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912 to the API
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'petrol',
 'id': '7102d58d-8e12-51ba-90bf-5b632bc53acf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV00912',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 251869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-28 12:12:08 [auto1.nl] INFO: Saving data for SV00912: {'auction_closing_time': 1774716963.0, 'created_time': 1774293144.132, 'last_price_update_time': 1774699928.19171}
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV00912') HTTP/1.1" 204 0
2026-03-28 12:12:08 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-28 12:12:08 [auto1.nl] INFO: Scrape type for ZP69271: 2
2026-03-28 12:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-28 12:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-28 12:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-28 12:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2a0c88c-cd3b-5216-a731-7031ed886f19, identifier: ZP69271
2026-03-28 12:12:08 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-28 12:12:08 [auto1.nl] INFO: Scrape type for BP06390: 2
2026-03-28 12:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-28 12:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-28 12:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-28 12:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08a060f5-5277-5051-b7fb-71f560fa26d1, identifier: BP06390
2026-03-28 12:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-28 12:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-28 12:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271 to the API
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'c2a0c88c-cd3b-5216-a731-7031ed886f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP69271',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 237750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2013}
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-28 12:12:08 [auto1.nl] INFO: Saving data for ZP69271: {'auction_closing_time': 1774715591.0, 'created_time': 1773343026.850206, 'last_price_update_time': 1774699928.698313}
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP69271') HTTP/1.1" 204 0
2026-03-28 12:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-28 12:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-28 12:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390 to the API
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'petrol',
 'id': '08a060f5-5277-5051-b7fb-71f560fa26d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP06390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-28 12:12:08 [auto1.nl] INFO: Saving data for BP06390: {'auction_closing_time': 1774714034.0, 'created_time': 1773688304.691821, 'last_price_update_time': 1774699928.993268}
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP06390') HTTP/1.1" 204 0
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-28 12:12:09 [auto1.nl] INFO: Scrape type for YB51800: 2
2026-03-28 12:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-28 12:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-28 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-28 12:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7ff8dcd-66f0-506a-bdae-d97b95d3b837, identifier: YB51800
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-28 12:12:09 [auto1.nl] INFO: Scrape type for SV78620: 2
2026-03-28 12:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-28 12:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-28 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-28 12:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31ff8b98-3084-5d24-b564-e88479fc5c4f, identifier: SV78620
2026-03-28 12:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-28 12:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-28 12:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800 to the API
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:54Z',
 'fuel_type': 'petrol',
 'id': 'e7ff8dcd-66f0-506a-bdae-d97b95d3b837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB51800',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 197308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-28 12:12:09 [auto1.nl] INFO: Saving data for YB51800: {'auction_closing_time': 1774713834.0, 'created_time': 1773515440.741206, 'last_price_update_time': 1774699929.55281}
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB51800') HTTP/1.1" 204 0
2026-03-28 12:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-28 12:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-28 12:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620 to the API
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:16Z',
 'fuel_type': 'diesel',
 'id': '31ff8b98-3084-5d24-b564-e88479fc5c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV78620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 150133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-28 12:12:09 [auto1.nl] INFO: Saving data for SV78620: {'auction_closing_time': 1774715716.0, 'created_time': 1773132445.149576, 'last_price_update_time': 1774699929.926612}
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV78620') HTTP/1.1" 204 0
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 12:12:09 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-28 12:12:09 [auto1.nl] INFO: Scrape type for CT81231: 2
2026-03-28 12:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-28 12:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with scrape type 2
2026-03-28 12:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2c318cb-82eb-5ef6-9ddf-86744bf6d895, identifier: CT81231
2026-03-28 12:12:10 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 12:12:10 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-28 12:12:10 [auto1.nl] INFO: Scrape type for JX11008: 2
2026-03-28 12:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-28 12:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a8b9678-0d61-5def-8158-cc26e8801efd, identifier: JX11008
2026-03-28 12:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-28 12:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-28 12:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231 to the API
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:58:10Z',
 'fuel_type': 'petrol',
 'id': 'f2c318cb-82eb-5ef6-9ddf-86744bf6d895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT81231',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 144636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2017}
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-28 12:12:10 [auto1.nl] INFO: Saving data for CT81231: {'auction_closing_time': 1774717090.0, 'created_time': 1774613490.949391, 'last_price_update_time': 1774699930.439485}
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT81231') HTTP/1.1" 204 0
2026-03-28 12:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-28 12:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-28 12:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008 to the API
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:17:20Z',
 'fuel_type': 'petrol',
 'id': '0a8b9678-0d61-5def-8158-cc26e8801efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX11008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 93298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-28 12:12:10 [auto1.nl] INFO: Saving data for JX11008: {'auction_closing_time': 1774714640.0, 'created_time': 1773749658.91943, 'last_price_update_time': 1774699930.700144}
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX11008') HTTP/1.1" 204 0
2026-03-28 12:12:10 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-28 12:12:10 [auto1.nl] INFO: Scrape type for JN77730: 2
2026-03-28 12:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-28 12:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5, identifier: JN77730
2026-03-28 12:12:10 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-28 12:12:10 [auto1.nl] INFO: Scrape type for YT76844: 2
2026-03-28 12:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-28 12:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-28 12:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-28 12:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: daf5ea50-607b-5503-ae3d-b3e4e21cde23, identifier: YT76844
2026-03-28 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-28 12:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-28 12:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730 to the API
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'petrol',
 'id': 'a11c3c1f-aac5-54eb-a602-5c6217d1cbb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 228593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-28 12:12:11 [auto1.nl] INFO: Saving data for JN77730: {'auction_closing_time': 1774716963.0, 'created_time': 1773749674.371386, 'last_price_update_time': 1774699931.2665}
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN77730') HTTP/1.1" 204 0
2026-03-28 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-28 12:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-28 12:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844 to the API
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:55:57Z',
 'fuel_type': 'petrol',
 'id': 'daf5ea50-607b-5503-ae3d-b3e4e21cde23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT76844',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-28 12:12:11 [auto1.nl] INFO: Saving data for YT76844: {'auction_closing_time': 1774716957.0, 'created_time': 1774293126.048266, 'last_price_update_time': 1774699931.53026}
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT76844') HTTP/1.1" 204 0
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-28 12:12:11 [auto1.nl] INFO: Scrape type for AE06801: 2
2026-03-28 12:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-28 12:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-28 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-28 12:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfff64aa-bf53-54ac-a935-97ce27e75a3b, identifier: AE06801
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 12:12:11 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-28 12:12:11 [auto1.nl] INFO: Scrape type for RC74228: 2
2026-03-28 12:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-28 12:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-28 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-28 12:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31976e2f-167d-5f4f-9a04-ea038cb88b30, identifier: RC74228
2026-03-28 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-28 12:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-28 12:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801 to the API
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'diesel',
 'id': 'cfff64aa-bf53-54ac-a935-97ce27e75a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE06801',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 114628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2017}
2026-03-28 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-28 12:12:12 [auto1.nl] INFO: Saving data for AE06801: {'auction_closing_time': 1774715096.0, 'created_time': 1773301378.278136, 'last_price_update_time': 1774699932.004215}
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE06801') HTTP/1.1" 204 0
2026-03-28 12:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-28 12:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-28 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228 to the API
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:26:01Z',
 'fuel_type': 'petrol',
 'id': '31976e2f-167d-5f4f-9a04-ea038cb88b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74228',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 209670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-28 12:12:12 [auto1.nl] INFO: Saving data for RC74228: {'auction_closing_time': 1774715161.0, 'created_time': 1773688671.00132, 'last_price_update_time': 1774699932.358835}
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74228') HTTP/1.1" 204 0
2026-03-28 12:12:12 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-28 12:12:12 [auto1.nl] INFO: Scrape type for VR09113: 2
2026-03-28 12:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-28 12:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04fa97e3-66df-50cc-9db9-719167ae7290 with scrape type 2
2026-03-28 12:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04fa97e3-66df-50cc-9db9-719167ae7290 with scrape type 2
2026-03-28 12:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04fa97e3-66df-50cc-9db9-719167ae7290, identifier: VR09113
2026-03-28 12:12:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:12:12 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 12:12:12 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 12:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-28 12:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-28 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113 to the API
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:17:00Z',
 'fuel_type': 'petrol',
 'id': '04fa97e3-66df-50cc-9db9-719167ae7290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR09113',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 75392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2016}
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-28 12:12:12 [auto1.nl] INFO: Saving data for VR09113: {'auction_closing_time': 1774714620.0, 'created_time': 1774613475.668072, 'last_price_update_time': 1774699932.722393}
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VR09113') HTTP/1.1" 204 0
2026-03-28 12:12:12 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-28 12:12:12 [auto1.nl] INFO: Scrape type for MW03156: 2
2026-03-28 12:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-28 12:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-28 12:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-28 12:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 42fb4e30-a8ac-5e51-9b32-a0d25768c890, identifier: MW03156
2026-03-28 12:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-28 12:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-28 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156 to the API
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:17:04Z',
 'fuel_type': 'petrol',
 'id': '42fb4e30-a8ac-5e51-9b32-a0d25768c890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW03156',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 163375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Saving data for MW03156: {'auction_closing_time': 1774714624.0, 'created_time': 1774095097.615821, 'last_price_update_time': 1774699933.104283}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW03156') HTTP/1.1" 204 0
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Scrape type for WG27101: 2
2026-03-28 12:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-28 12:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f, identifier: WG27101
2026-03-28 12:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-28 12:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-28 12:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101 to the API
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:23:11Z',
 'fuel_type': 'petrol',
 'id': 'b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 226784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Saving data for WG27101: {'auction_closing_time': 1774714991.0, 'created_time': 1773301517.942438, 'last_price_update_time': 1774699933.482167}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG27101') HTTP/1.1" 204 0
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Scrape type for AX06352: 2
2026-03-28 12:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-28 12:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3457c2fc-3ceb-56de-821f-c366bb033387, identifier: AX06352
2026-03-28 12:12:13 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1045 | hits on page: 40
2026-03-28 12:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-28 12:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-28 12:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352 to the API
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'diesel',
 'id': '3457c2fc-3ceb-56de-821f-c366bb033387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX06352',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 222877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-03',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2011}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Saving data for AX06352: {'auction_closing_time': 1774716963.0, 'created_time': 1774268081.306856, 'last_price_update_time': 1774699933.871717}
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX06352') HTTP/1.1" 204 0
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-28 12:12:13 [auto1.nl] INFO: Scrape type for YE50957: 2
2026-03-28 12:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-28 12:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with scrape type 2
2026-03-28 12:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df, identifier: YE50957
2026-03-28 12:12:13 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-28 12:12:14 [auto1.nl] INFO: Scrape type for SW07946: 2
2026-03-28 12:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-28 12:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d36e696-242f-50bd-b51a-cb662ac69482 with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d36e696-242f-50bd-b51a-cb662ac69482 with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d36e696-242f-50bd-b51a-cb662ac69482, identifier: SW07946
2026-03-28 12:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-28 12:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-28 12:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957 to the API
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'petrol',
 'id': '4c8de35b-ef90-5ef7-9bd4-77e49765b5df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE50957',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 136810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2019}
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-28 12:12:14 [auto1.nl] INFO: Saving data for YE50957: {'auction_closing_time': 1774714961.0, 'created_time': 1774613476.007134, 'last_price_update_time': 1774699934.409177}
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE50957') HTTP/1.1" 204 0
2026-03-28 12:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-28 12:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-28 12:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946 to the API
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:57:44Z',
 'fuel_type': 'petrol',
 'id': '4d36e696-242f-50bd-b51a-cb662ac69482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW07946',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 212267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-15',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2006}
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-28 12:12:14 [auto1.nl] INFO: Saving data for SW07946: {'auction_closing_time': 1774717064.0, 'created_time': 1774613497.222004, 'last_price_update_time': 1774699934.687445}
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW07946') HTTP/1.1" 204 0
2026-03-28 12:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-28 12:12:14 [auto1.nl] INFO: Scrape type for EU67961: 2
2026-03-28 12:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-28 12:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74959324-1a2f-505c-96c1-7657c4c75a9f, identifier: EU67961
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 12:12:14 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-28 12:12:14 [auto1.nl] INFO: Scrape type for CK43593: 2
2026-03-28 12:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-28 12:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-28 12:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595, identifier: CK43593
2026-03-28 12:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-28 12:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-28 12:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961 to the API
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:31Z',
 'fuel_type': 'petrol',
 'id': '74959324-1a2f-505c-96c1-7657c4c75a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU67961',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 186342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-28 12:12:15 [auto1.nl] INFO: Saving data for EU67961: {'auction_closing_time': 1774713751.0, 'created_time': 1773688317.813995, 'last_price_update_time': 1774699935.203569}
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU67961') HTTP/1.1" 204 0
2026-03-28 12:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-28 12:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-28 12:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593 to the API
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:36:00Z',
 'fuel_type': 'hybrid',
 'id': '460e7c1b-55ba-5cb7-8b3b-97a5defd2595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK43593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 83270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-28 12:12:15 [auto1.nl] INFO: Saving data for CK43593: {'auction_closing_time': 1774715760.0, 'created_time': 1773861137.497922, 'last_price_update_time': 1774699935.569577}
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK43593') HTTP/1.1" 204 0
2026-03-28 12:12:15 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 12:12:15 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-28 12:12:15 [auto1.nl] INFO: Scrape type for PK52304: 2
2026-03-28 12:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-28 12:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba4d92-838d-5542-9f04-425e067d37e7 with scrape type 2
2026-03-28 12:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fba4d92-838d-5542-9f04-425e067d37e7 with scrape type 2
2026-03-28 12:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6fba4d92-838d-5542-9f04-425e067d37e7, identifier: PK52304
2026-03-28 12:12:15 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-28 12:12:15 [auto1.nl] INFO: Scrape type for FR68688: 2
2026-03-28 12:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-28 12:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 2
2026-03-28 12:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 2
2026-03-28 12:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76a1108c-b5d7-57a0-89e5-34b437f0fb40, identifier: FR68688
2026-03-28 12:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-28 12:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-28 12:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304 to the API
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 52,
 'expiration_date': '2026-03-28T16:48:53Z',
 'fuel_type': 'petrol',
 'id': '6fba4d92-838d-5542-9f04-425e067d37e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK52304',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 156250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-29',
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 AT',
 'transmission': 'automatic',
 'trim': 'AT',
 'year': 2005}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-28 12:12:16 [auto1.nl] INFO: Saving data for PK52304: {'auction_closing_time': 1774716533.0, 'created_time': 1774613477.847902, 'last_price_update_time': 1774699936.037633}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK52304') HTTP/1.1" 204 0
2026-03-28 12:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-28 12:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-28 12:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688 to the API
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:24:59Z',
 'fuel_type': 'petrol',
 'id': '76a1108c-b5d7-57a0-89e5-34b437f0fb40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR68688',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 270252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-28 12:12:16 [auto1.nl] INFO: Saving data for FR68688: {'auction_closing_time': 1774715099.0, 'created_time': 1774613498.176328, 'last_price_update_time': 1774699936.328346}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR68688') HTTP/1.1" 204 0
2026-03-28 12:12:16 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 12:12:16 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-28 12:12:16 [auto1.nl] INFO: Scrape type for SY05694: 2
2026-03-28 12:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-28 12:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-28 12:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-28 12:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c97aa07e-16f6-5199-bab2-4ee85e79a62e, identifier: SY05694
2026-03-28 12:12:16 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-28 12:12:16 [auto1.nl] INFO: Scrape type for XG40529: 2
2026-03-28 12:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-28 12:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with scrape type 2
2026-03-28 12:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with scrape type 2
2026-03-28 12:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8, identifier: XG40529
2026-03-28 12:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-28 12:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-28 12:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694 to the API
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:40Z',
 'fuel_type': 'petrol',
 'id': 'c97aa07e-16f6-5199-bab2-4ee85e79a62e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY05694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2016}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-28 12:12:16 [auto1.nl] INFO: Saving data for SY05694: {'auction_closing_time': 1774713880.0, 'created_time': 1774379539.06068, 'last_price_update_time': 1774699936.843565}
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY05694') HTTP/1.1" 204 0
2026-03-28 12:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-28 12:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-28 12:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529 to the API
2026-03-28 12:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:49:58Z',
 'fuel_type': 'petrol',
 'id': '7fe5f167-9d3a-5199-ab25-73b052b1dfa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG40529',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 199270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-16',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.4 Platino DFN',
 'transmission': 'automatic',
 'trim': 'Platino DFN',
 'year': 2004}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Saving data for XG40529: {'auction_closing_time': 1774716598.0, 'created_time': 1773429292.398222, 'last_price_update_time': 1774699937.121093}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG40529') HTTP/1.1" 204 0
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Scrape type for ZL63379: 2
2026-03-28 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-28 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-28 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-28 12:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7b266567-6345-5a83-bee7-618f3c719214, identifier: ZL63379
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Scrape type for HK90585: 2
2026-03-28 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-28 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-28 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-28 12:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14de2679-1d2d-5a57-997b-0f391724915e, identifier: HK90585
2026-03-28 12:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-28 12:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-28 12:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379 to the API
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:42:11Z',
 'fuel_type': 'petrol',
 'id': '7b266567-6345-5a83-bee7-618f3c719214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL63379',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 99854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Saving data for ZL63379: {'auction_closing_time': 1774716131.0, 'created_time': 1774293145.040534, 'last_price_update_time': 1774699937.64153}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL63379') HTTP/1.1" 204 0
2026-03-28 12:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-28 12:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-28 12:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585 to the API
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:13Z',
 'fuel_type': 'diesel',
 'id': '14de2679-1d2d-5a57-997b-0f391724915e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK90585',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 194876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Saving data for HK90585: {'auction_closing_time': 1774714153.0, 'created_time': 1774293136.267029, 'last_price_update_time': 1774699937.920888}
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK90585') HTTP/1.1" 204 0
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 12:12:17 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-28 12:12:17 [auto1.nl] INFO: Scrape type for CR31925: 2
2026-03-28 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-28 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-28 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-28 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6, identifier: CR31925
2026-03-28 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-28 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-28 12:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925 to the API
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:38:48Z',
 'fuel_type': 'hybrid',
 'id': 'e8423ee1-8d09-5c80-a8df-ebb9725d2cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR31925',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-28 12:12:18 [auto1.nl] INFO: Saving data for CR31925: {'auction_closing_time': 1774715928.0, 'created_time': 1773688307.528593, 'last_price_update_time': 1774699938.305912}
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR31925') HTTP/1.1" 204 0
2026-03-28 12:12:18 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-28 12:12:18 [auto1.nl] INFO: Scrape type for BM13348: 2
2026-03-28 12:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-28 12:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc with scrape type 2
2026-03-28 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc with scrape type 2
2026-03-28 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6e57e3dd-efcf-52e5-8a14-6ed566443adc, identifier: BM13348
2026-03-28 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-28 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-28 12:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348 to the API
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:17:45Z',
 'fuel_type': 'diesel',
 'id': '6e57e3dd-efcf-52e5-8a14-6ed566443adc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM13348',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 257552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-28 12:12:18 [auto1.nl] INFO: Saving data for BM13348: {'auction_closing_time': 1774714665.0, 'created_time': 1774613493.204614, 'last_price_update_time': 1774699938.769185}
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM13348') HTTP/1.1" 204 0
2026-03-28 12:12:18 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 12:12:18 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-28 12:12:18 [auto1.nl] INFO: Scrape type for FP18275: 2
2026-03-28 12:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-28 12:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 2
2026-03-28 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 2
2026-03-28 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06c58ffe-f265-56ac-a40a-3ef24aa59319, identifier: FP18275
2026-03-28 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-28 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-28 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275 to the API
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:47Z',
 'fuel_type': 'diesel',
 'id': '06c58ffe-f265-56ac-a40a-3ef24aa59319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP18275',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 295232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Saving data for FP18275: {'auction_closing_time': 1774716287.0, 'created_time': 1774613496.826994, 'last_price_update_time': 1774699939.164619}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP18275') HTTP/1.1" 204 0
2026-03-28 12:12:19 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 12:12:19 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Scrape type for BV58634: 2
2026-03-28 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-28 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 2
2026-03-28 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 2
2026-03-28 12:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34fb2b73-5837-529b-a0ca-24316a72a084, identifier: BV58634
2026-03-28 12:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-28 12:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-28 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634 to the API
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:44:42Z',
 'fuel_type': 'petrol',
 'id': '34fb2b73-5837-529b-a0ca-24316a72a084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV58634',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 241773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-06',
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Saving data for BV58634: {'auction_closing_time': 1774716282.0, 'created_time': 1774613490.507858, 'last_price_update_time': 1774699939.565107}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV58634') HTTP/1.1" 204 0
2026-03-28 12:12:19 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Scrape type for MD45251: 2
2026-03-28 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-28 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 2
2026-03-28 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 2
2026-03-28 12:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 666aa210-f426-54cd-a1d4-3adb8819bfed, identifier: MD45251
2026-03-28 12:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-28 12:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-28 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251 to the API
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:13:36Z',
 'fuel_type': 'petrol',
 'id': '666aa210-f426-54cd-a1d4-3adb8819bfed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD45251',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 114858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Saving data for MD45251: {'auction_closing_time': 1774714416.0, 'created_time': 1774613492.552532, 'last_price_update_time': 1774699939.956729}
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD45251') HTTP/1.1" 204 0
2026-03-28 12:12:19 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 12:12:19 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-28 12:12:19 [auto1.nl] INFO: Scrape type for RM47540: 2
2026-03-28 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-28 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with scrape type 2
2026-03-28 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0, identifier: RM47540
2026-03-28 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-28 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-28 12:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540 to the API
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:56:24Z',
 'fuel_type': 'hybrid',
 'id': 'c09a5f55-2a05-5deb-ade7-87a1bc21f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM47540',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 199507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-01',
 'seller_name': None,
 'title': 'BMW 3er 330e Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-28 12:12:20 [auto1.nl] INFO: Saving data for RM47540: {'auction_closing_time': 1774716984.0, 'created_time': 1773926989.972535, 'last_price_update_time': 1774699940.34828}
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RM47540') HTTP/1.1" 204 0
2026-03-28 12:12:20 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1045 | hits on page: 5
2026-03-28 12:12:20 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-28 12:12:20 [auto1.nl] INFO: Scrape type for DZ87358: 2
2026-03-28 12:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-28 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d, identifier: DZ87358
2026-03-28 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-28 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-28 12:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358 to the API
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:26:15Z',
 'fuel_type': 'diesel',
 'id': 'b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ87358',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 200238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-28 12:12:20 [auto1.nl] INFO: Saving data for DZ87358: {'auction_closing_time': 1774715175.0, 'created_time': 1774613499.48183, 'last_price_update_time': 1774699940.749746}
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DZ87358') HTTP/1.1" 204 0
2026-03-28 12:12:20 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 12:12:20 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-28 12:12:20 [auto1.nl] INFO: Scrape type for RP15329: 2
2026-03-28 12:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-28 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6e36aaa-9465-5f90-b367-9e8c15905c1d, identifier: RP15329
2026-03-28 12:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 12:12:20 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 12:12:20 [auto1.nl] INFO: Scrape type for GN29290: 2
2026-03-28 12:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-28 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d870f5-f553-571d-9e90-79e301fa3cd6 with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d870f5-f553-571d-9e90-79e301fa3cd6 with scrape type 2
2026-03-28 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20d870f5-f553-571d-9e90-79e301fa3cd6, identifier: GN29290
2026-03-28 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-28 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-28 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329 to the API
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:38Z',
 'fuel_type': 'petrol',
 'id': 'e6e36aaa-9465-5f90-b367-9e8c15905c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15329',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-12',
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-28 12:12:21 [auto1.nl] INFO: Saving data for RP15329: {'auction_closing_time': 1774715618.0, 'created_time': 1773663987.605195, 'last_price_update_time': 1774699941.224959}
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP15329') HTTP/1.1" 204 0
2026-03-28 12:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-28 12:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-28 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290 to the API
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:20Z',
 'fuel_type': 'petrol',
 'id': '20d870f5-f553-571d-9e90-79e301fa3cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN29290',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 151554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-13',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2007}
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-28 12:12:21 [auto1.nl] INFO: Saving data for GN29290: {'auction_closing_time': 1774717160.0, 'created_time': 1774613481.217498, 'last_price_update_time': 1774699941.624605}
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN29290') HTTP/1.1" 204 0
2026-03-28 12:12:21 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 12:12:21 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 12:12:21 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-28 12:12:21 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-28 12:12:21 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-28 12:12:21 [auto1.nl] INFO: Scrape type for DN96174: 2
2026-03-28 12:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-28 12:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-28 12:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-28 12:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eec40764-0309-5557-b786-0425ed702cb4, identifier: DN96174
2026-03-28 12:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-28 12:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-28 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174 to the API
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:26:47Z',
 'fuel_type': 'petrol',
 'id': 'eec40764-0309-5557-b786-0425ed702cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 133526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Renault Clio 1.6 TCe Renault Sport Trophy',
 'transmission': 'automatic',
 'trim': 'Sport Trophy',
 'year': 2016}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Saving data for DN96174: {'auction_closing_time': 1774715207.0, 'created_time': 1773924417.172091, 'last_price_update_time': 1774699942.025712}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DN96174') HTTP/1.1" 204 0
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Scrape type for BG27703: 2
2026-03-28 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-28 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9, identifier: BG27703
2026-03-28 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-28 12:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-28 12:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703 to the API
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:07:52Z',
 'fuel_type': 'diesel',
 'id': 'aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27703',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 350023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-13',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kasten',
 'transmission': 'automatic',
 'trim': 'Kasten',
 'year': 2013}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Saving data for BG27703: {'auction_closing_time': 1774714072.0, 'created_time': 1774613496.083068, 'last_price_update_time': 1774699942.425756}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG27703') HTTP/1.1" 204 0
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Scrape type for EB00697: 2
2026-03-28 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-28 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b36c08-995b-57ef-acbe-81463121f442 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5b36c08-995b-57ef-acbe-81463121f442 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b5b36c08-995b-57ef-acbe-81463121f442, identifier: EB00697
2026-03-28 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-28 12:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-28 12:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697 to the API
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 430,
 'expiration_date': '2026-03-28T16:07:55Z',
 'fuel_type': 'petrol',
 'id': 'b5b36c08-995b-57ef-acbe-81463121f442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB00697',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 122496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Porsche Panamera GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Saving data for EB00697: {'auction_closing_time': 1774714075.0, 'created_time': 1774613480.339282, 'last_price_update_time': 1774699942.822102}
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB00697') HTTP/1.1" 204 0
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 12:12:22 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-28 12:12:22 [auto1.nl] INFO: Scrape type for ES69537: 2
2026-03-28 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-28 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 2
2026-03-28 12:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c06f76bb-78a1-59c3-8429-b24b0bd15fe7, identifier: ES69537
2026-03-28 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-28 12:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-28 12:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537 to the API
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:15Z',
 'fuel_type': 'petrol',
 'id': 'c06f76bb-78a1-59c3-8429-b24b0bd15fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES69537',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 134147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-28 12:12:23 [auto1.nl] INFO: Saving data for ES69537: {'auction_closing_time': 1774715475.0, 'created_time': 1774613492.143398, 'last_price_update_time': 1774699943.226027}
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ES69537') HTTP/1.1" 204 0
2026-03-28 12:12:23 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-28 12:12:23 [auto1.nl] INFO: Scrape type for WY03082: 2
2026-03-28 12:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-28 12:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90dc9897-29a0-5e78-b13e-74b15d6316b1 with scrape type 2
2026-03-28 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90dc9897-29a0-5e78-b13e-74b15d6316b1 with scrape type 2
2026-03-28 12:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90dc9897-29a0-5e78-b13e-74b15d6316b1, identifier: WY03082
2026-03-28 12:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-28 12:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-28 12:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082 to the API
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': '90dc9897-29a0-5e78-b13e-74b15d6316b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY03082',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 170374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-28 12:12:23 [auto1.nl] INFO: Saving data for WY03082: {'auction_closing_time': 1774713765.0, 'created_time': 1774613486.038029, 'last_price_update_time': 1774699943.615278}
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY03082') HTTP/1.1" 204 0
2026-03-28 12:12:23 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 12:12:23 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-28 12:12:23 [auto1.nl] INFO: Scrape type for CJ41969: 2
2026-03-28 12:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-28 12:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-28 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-28 12:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 989cd8af-4413-519c-8a53-52c650ff5aaf, identifier: CJ41969
2026-03-28 12:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-28 12:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-28 12:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969 to the API
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'diesel',
 'id': '989cd8af-4413-519c-8a53-52c650ff5aaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ41969',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 175739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2014}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Saving data for CJ41969: {'auction_closing_time': 1774715403.0, 'created_time': 1773342965.438828, 'last_price_update_time': 1774699944.08788}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ41969') HTTP/1.1" 204 0
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Scrape type for UF96545: 2
2026-03-28 12:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-28 12:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1191053-835c-5ec0-bcdc-3ddbaf91671e with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1191053-835c-5ec0-bcdc-3ddbaf91671e with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1191053-835c-5ec0-bcdc-3ddbaf91671e, identifier: UF96545
2026-03-28 12:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-28 12:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-28 12:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545 to the API
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:03:47Z',
 'fuel_type': 'petrol',
 'id': 'f1191053-835c-5ec0-bcdc-3ddbaf91671e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF96545',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 179029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2017}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Saving data for UF96545: {'auction_closing_time': 1774713827.0, 'created_time': 1774613483.970692, 'last_price_update_time': 1774699944.4594}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF96545') HTTP/1.1" 204 0
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Scrape type for GL61326: 2
2026-03-28 12:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-28 12:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536b061a-4d1f-52ff-bc34-542fbd256f0d with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 536b061a-4d1f-52ff-bc34-542fbd256f0d with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 536b061a-4d1f-52ff-bc34-542fbd256f0d, identifier: GL61326
2026-03-28 12:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-28 12:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-28 12:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326 to the API
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:04:27Z',
 'fuel_type': 'diesel',
 'id': '536b061a-4d1f-52ff-bc34-542fbd256f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61326',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-07',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Saving data for GL61326: {'auction_closing_time': 1774713867.0, 'created_time': 1774613484.779007, 'last_price_update_time': 1774699944.859155}
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL61326') HTTP/1.1" 204 0
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 12:12:24 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-28 12:12:24 [auto1.nl] INFO: Scrape type for SY10793: 2
2026-03-28 12:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-28 12:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69eeae17-cb4c-5500-8736-e5d694b982b9 with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69eeae17-cb4c-5500-8736-e5d694b982b9 with scrape type 2
2026-03-28 12:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69eeae17-cb4c-5500-8736-e5d694b982b9, identifier: SY10793
2026-03-28 12:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 12:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-28 12:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-28 12:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793 to the API
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:09Z',
 'fuel_type': 'petrol',
 'id': '69eeae17-cb4c-5500-8736-e5d694b982b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY10793',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 197754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-28 12:12:25 [auto1.nl] INFO: Saving data for SY10793: {'auction_closing_time': 1774716609.0, 'created_time': 1774613482.730974, 'last_price_update_time': 1774699945.247464}
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY10793') HTTP/1.1" 204 0
2026-03-28 12:12:25 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 12:12:25 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 12:12:25 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-28 12:12:25 [auto1.nl] INFO: Scrape type for EY85081: 2
2026-03-28 12:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-28 12:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 2
2026-03-28 12:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 2
2026-03-28 12:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 608255fa-49ac-5b03-af1c-6a8855f26943, identifier: EY85081
2026-03-28 12:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-28 12:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-28 12:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081 to the API
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 12:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:37Z',
 'fuel_type': 'petrol',
 'id': '608255fa-49ac-5b03-af1c-6a8855f26943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY85081',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 132697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-28 12:12:25 [auto1.nl] INFO: Saving data for EY85081: {'auction_closing_time': 1774716337.0, 'created_time': 1774613495.617623, 'last_price_update_time': 1774699945.61946}
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY85081') HTTP/1.1" 204 0
2026-03-28 12:12:25 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 12:12:25 [auto1.nl] INFO: Channel: 24h | Page: 28 | totalHits: 1045 | hits on page: 0
2026-03-28 12:12:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 12:12:25 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-28 12:12:25 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 12:12:25 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (152 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-28T12_10_00.jl
2026-03-28 12:12:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 864258,
 'downloader/request_count': 502,
 'downloader/request_method_count/GET': 472,
 'downloader/request_method_count/POST': 30,
 'downloader/response_bytes': 184797447,
 'downloader/response_count': 502,
 'downloader/response_status_count/200': 502,
 'dupefilter/filtered': 15,
 'elapsed_time_seconds': 139.0131,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 12, 12, 25, 813372, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 152,
 'log_count/DEBUG': 5258,
 'log_count/INFO': 5609,
 'memusage/max': 198090752,
 'memusage/startup': 149843968,
 'photo_download_count': 360,
 'request_depth_max': 31,
 'response_received_count': 142,
 'scheduler/dequeued': 502,
 'scheduler/dequeued/memory': 502,
 'scheduler/enqueued': 502,
 'scheduler/enqueued/memory': 502,
 'scrape_type/batch_skipped': 541,
 'scrape_type/new': 55,
 'scrape_type/price_update': 97,
 'scrape_type/skipped': 377,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 142,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.4424593527604572,
 'scrapy-zyte-api/mean_response_seconds': 2.464504733170106,
 'scrapy-zyte-api/processed': 142,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 142,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 141,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 142,
 'scrapy-zyte-api/request_args/httpRequestBody': 30,
 'scrapy-zyte-api/request_args/httpRequestMethod': 30,
 'scrapy-zyte-api/request_args/httpResponseBody': 142,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 142,
 'scrapy-zyte-api/request_args/sessionContext': 142,
 'scrapy-zyte-api/request_args/url': 142,
 'scrapy-zyte-api/status_codes/200': 142,
 'scrapy-zyte-api/success': 142,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1085,
 'source/total_available': 1045,
 'start_time': datetime.datetime(2026, 3, 28, 12, 10, 6, 800272, tzinfo=datetime.timezone.utc)}
2026-03-28 12:12:25 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 12:12:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f913bf35c50>
2026-03-28 12:12:25 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f913c05ff50>