2026-03-27 19:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 19:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 19:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-27 19:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-27 19:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 19:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 19:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 19:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 19:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: 10f8a2fa940b248b
2026-03-27 19:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 19:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-27T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 19:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 19:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 19:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 19:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 19:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-27 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 19:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 19:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 19:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 19:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 19:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 19:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 19:00:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 19:00:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 19:00:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 19:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 19:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 19:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 19:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 19:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 19:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 19:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 19:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 19:00:15 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:15 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-27 19:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-27 19:00:15 [auto1.nl] INFO: Scrape type for TF89424: 2
2026-03-27 19:00:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-27 19:00:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-27 19:00:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46568cf-5996-58d7-b399-896c2a31ade2 with scrape type 2
2026-03-27 19:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46568cf-5996-58d7-b399-896c2a31ade2, identifier: TF89424
2026-03-27 19:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 19:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 19:00:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424
2026-03-27 19:00:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46568cf-5996-58d7-b399-896c2a31ade2 with identifier: TF89424 to the API
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:49:17Z',
 'fuel_type': 'petrol',
 'id': 'c46568cf-5996-58d7-b399-896c2a31ade2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF89424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 147131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-29',
 'seller_name': None,
 'title': 'Audi A5 Sportback 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Saving data for TF89424: {'auction_closing_time': 1774716557.0, 'created_time': 1773405907.997885, 'last_price_update_time': 1774638017.053978}
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF89424') HTTP/1.1" 204 0
2026-03-27 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for AR13994: 1
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for CA41421: 1
2026-03-27 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for ZA54727: 2
2026-03-27 19:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2290a77d-e064-517e-b522-3721a56b35a7 with identifier: ZA54727
2026-03-27 19:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2290a77d-e064-517e-b522-3721a56b35a7 with scrape type 2
2026-03-27 19:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2290a77d-e064-517e-b522-3721a56b35a7 with scrape type 2
2026-03-27 19:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2290a77d-e064-517e-b522-3721a56b35a7, identifier: ZA54727
2026-03-27 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2290a77d-e064-517e-b522-3721a56b35a7 with identifier: ZA54727
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2290a77d-e064-517e-b522-3721a56b35a7 with identifier: ZA54727
2026-03-27 19:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2290a77d-e064-517e-b522-3721a56b35a7 with identifier: ZA54727 to the API
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'hybrid',
 'id': '2290a77d-e064-517e-b522-3721a56b35a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA54727',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 211099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Saving data for ZA54727: {'auction_closing_time': 1774713779.0, 'created_time': 1773135286.286465, 'last_price_update_time': 1774638017.767534}
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZA54727') HTTP/1.1" 204 0
2026-03-27 19:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for BX02996: 1
2026-03-27 19:00:17 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-27 19:00:17 [auto1.nl] INFO: Scrape type for RY27630: 2
2026-03-27 19:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc03a72c-821d-5f9f-b617-2a550afc75d8 with identifier: RY27630
2026-03-27 19:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc03a72c-821d-5f9f-b617-2a550afc75d8 with scrape type 2
2026-03-27 19:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc03a72c-821d-5f9f-b617-2a550afc75d8 with scrape type 2
2026-03-27 19:00:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc03a72c-821d-5f9f-b617-2a550afc75d8, identifier: RY27630
2026-03-27 19:00:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc03a72c-821d-5f9f-b617-2a550afc75d8 with identifier: RY27630
2026-03-27 19:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc03a72c-821d-5f9f-b617-2a550afc75d8 with identifier: RY27630
2026-03-27 19:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc03a72c-821d-5f9f-b617-2a550afc75d8 with identifier: RY27630 to the API
2026-03-27 19:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:01:13Z',
 'fuel_type': 'petrol',
 'id': 'fc03a72c-821d-5f9f-b617-2a550afc75d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY27630',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 178782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-06',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-27 19:00:19 [auto1.nl] INFO: Saving data for RY27630: {'auction_closing_time': 1774713673.0, 'created_time': 1773132028.797887, 'last_price_update_time': 1774638019.244403}
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RY27630') HTTP/1.1" 204 0
2026-03-27 19:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:19 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 19:00:19 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-27 19:00:19 [auto1.nl] INFO: Scrape type for FE12544: 2
2026-03-27 19:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37dd26f6-b22c-533b-814b-2035a08c0842 with identifier: FE12544
2026-03-27 19:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37dd26f6-b22c-533b-814b-2035a08c0842 with scrape type 2
2026-03-27 19:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37dd26f6-b22c-533b-814b-2035a08c0842 with scrape type 2
2026-03-27 19:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 37dd26f6-b22c-533b-814b-2035a08c0842, identifier: FE12544
2026-03-27 19:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 37dd26f6-b22c-533b-814b-2035a08c0842 with identifier: FE12544
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 19:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 37dd26f6-b22c-533b-814b-2035a08c0842 with identifier: FE12544
2026-03-27 19:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 37dd26f6-b22c-533b-814b-2035a08c0842 with identifier: FE12544 to the API
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:03:11Z',
 'fuel_type': 'petrol',
 'id': '37dd26f6-b22c-533b-814b-2035a08c0842',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE12544',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 90984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-27 19:00:19 [auto1.nl] INFO: Saving data for FE12544: {'auction_closing_time': 1774713791.0, 'created_time': 1773232144.871307, 'last_price_update_time': 1774638019.902562}
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE12544') HTTP/1.1" 204 0
2026-03-27 19:00:20 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-27 19:00:20 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-27 19:00:20 [auto1.nl] INFO: Scrape type for CG41463: 1
2026-03-27 19:00:20 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-27 19:00:20 [auto1.nl] INFO: Scrape type for FV36091: 2
2026-03-27 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with identifier: FV36091
2026-03-27 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with scrape type 2
2026-03-27 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with scrape type 2
2026-03-27 19:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f7ae053-2c5e-537a-a15a-d2c190a01c5e, identifier: FV36091
2026-03-27 19:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with identifier: FV36091
2026-03-27 19:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with identifier: FV36091
2026-03-27 19:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f7ae053-2c5e-537a-a15a-d2c190a01c5e with identifier: FV36091 to the API
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:55:09Z',
 'fuel_type': 'petrol',
 'id': '8f7ae053-2c5e-537a-a15a-d2c190a01c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV36091',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 195676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-09',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-27 19:00:20 [auto1.nl] INFO: Saving data for FV36091: {'auction_closing_time': 1774716909.0, 'created_time': 1773232110.76501, 'last_price_update_time': 1774638020.507882}
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FV36091') HTTP/1.1" 204 0
2026-03-27 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:20 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-27 19:00:20 [auto1.nl] INFO: Scrape type for SJ21377: 2
2026-03-27 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with identifier: SJ21377
2026-03-27 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with scrape type 2
2026-03-27 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with scrape type 2
2026-03-27 19:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9890d99e-0d84-5188-acf3-5dcfb4b9bea7, identifier: SJ21377
2026-03-27 19:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with identifier: SJ21377
2026-03-27 19:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with identifier: SJ21377
2026-03-27 19:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9890d99e-0d84-5188-acf3-5dcfb4b9bea7 with identifier: SJ21377 to the API
2026-03-27 19:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:58:05Z',
 'fuel_type': 'petrol',
 'id': '9890d99e-0d84-5188-acf3-5dcfb4b9bea7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ21377',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 198495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-13',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-27 19:00:21 [auto1.nl] INFO: Saving data for SJ21377: {'auction_closing_time': 1774717085.0, 'created_time': 1773232393.772051, 'last_price_update_time': 1774638021.956952}
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SJ21377') HTTP/1.1" 204 0
2026-03-27 19:00:21 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-27 19:00:21 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 19:00:21 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-27 19:00:21 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-27 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Scrape type for DG42232: 2
2026-03-27 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f935f5-d170-55a2-8bab-6453af79fd9b with identifier: DG42232
2026-03-27 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f935f5-d170-55a2-8bab-6453af79fd9b with scrape type 2
2026-03-27 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f935f5-d170-55a2-8bab-6453af79fd9b with scrape type 2
2026-03-27 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9f935f5-d170-55a2-8bab-6453af79fd9b, identifier: DG42232
2026-03-27 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9f935f5-d170-55a2-8bab-6453af79fd9b with identifier: DG42232
2026-03-27 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9f935f5-d170-55a2-8bab-6453af79fd9b with identifier: DG42232
2026-03-27 19:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9f935f5-d170-55a2-8bab-6453af79fd9b with identifier: DG42232 to the API
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:31:11Z',
 'fuel_type': 'petrol',
 'id': 'f9f935f5-d170-55a2-8bab-6453af79fd9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG42232',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 140407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Saving data for DG42232: {'auction_closing_time': 1774715471.0, 'created_time': 1773232098.655278, 'last_price_update_time': 1774638022.381946}
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG42232') HTTP/1.1" 204 0
2026-03-27 19:00:22 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 19:00:22 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-27 19:00:22 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-27 19:00:22 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Scrape type for EU22503: 2
2026-03-27 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bae38d90-33e3-514b-b697-e2a40333681e with identifier: EU22503
2026-03-27 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bae38d90-33e3-514b-b697-e2a40333681e with scrape type 2
2026-03-27 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bae38d90-33e3-514b-b697-e2a40333681e with scrape type 2
2026-03-27 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: bae38d90-33e3-514b-b697-e2a40333681e, identifier: EU22503
2026-03-27 19:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR13994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: bae38d90-33e3-514b-b697-e2a40333681e with identifier: EU22503
2026-03-27 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: bae38d90-33e3-514b-b697-e2a40333681e with identifier: EU22503
2026-03-27 19:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: bae38d90-33e3-514b-b697-e2a40333681e with identifier: EU22503 to the API
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:19:39Z',
 'fuel_type': 'petrol',
 'id': 'bae38d90-33e3-514b-b697-e2a40333681e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU22503',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 63516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Feline Titane',
 'transmission': 'manual',
 'trim': 'Feline Titane',
 'year': 2013}
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-27 19:00:22 [auto1.nl] INFO: Saving data for EU22503: {'auction_closing_time': 1774714779.0, 'created_time': 1773232085.451155, 'last_price_update_time': 1774638022.940519}
2026-03-27 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU22503') HTTP/1.1" 204 0
2026-03-27 19:00:23 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-27 19:00:23 [auto1.nl] INFO: Scrape type for CS76145: 2
2026-03-27 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with identifier: CS76145
2026-03-27 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with scrape type 2
2026-03-27 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with scrape type 2
2026-03-27 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3, identifier: CS76145
2026-03-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with identifier: CS76145
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with identifier: CS76145
2026-03-27 19:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3 with identifier: CS76145 to the API
2026-03-27 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'diesel',
 'id': '7d9d6818-1dbd-5f3d-bcc1-3f1c3d2cf7a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS76145',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 222709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-05',
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d xLine',
 'transmission': 'manual',
 'trim': 'xLine',
 'year': 2017}
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-27 19:00:24 [auto1.nl] INFO: Saving data for CS76145: {'auction_closing_time': 1774716613.0, 'created_time': 1773132773.68178, 'last_price_update_time': 1774638024.463791}
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CS76145') HTTP/1.1" 204 0
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-27 19:00:24 [auto1.nl] INFO: Scrape type for GA85229: 2
2026-03-27 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with identifier: GA85229
2026-03-27 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with scrape type 2
2026-03-27 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with scrape type 2
2026-03-27 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 842bf9d2-259e-5dc4-9b98-5a916f8b2aea, identifier: GA85229
2026-03-27 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX02996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA41421/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with identifier: GA85229
2026-03-27 19:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with identifier: GA85229
2026-03-27 19:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 842bf9d2-259e-5dc4-9b98-5a916f8b2aea with identifier: GA85229 to the API
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:01:47Z',
 'fuel_type': 'petrol',
 'id': '842bf9d2-259e-5dc4-9b98-5a916f8b2aea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA85229',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 114749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-27 19:00:24 [auto1.nl] INFO: Saving data for GA85229: {'auction_closing_time': 1774713707.0, 'created_time': 1773232113.321385, 'last_price_update_time': 1774638024.95326}
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA85229') HTTP/1.1" 204 0
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-27 19:00:24 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-27 19:00:24 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-27 19:00:25 [auto1.nl] INFO: Scrape type for UE74675: 2
2026-03-27 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-27 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-27 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-27 19:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 68b6c843-8a8a-563b-874e-9f9237552b00, identifier: UE74675
2026-03-27 19:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-27 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-27 19:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675 to the API
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:20:08Z',
 'fuel_type': 'petrol',
 'id': '68b6c843-8a8a-563b-874e-9f9237552b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE74675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 120637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2018}
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-27 19:00:25 [auto1.nl] INFO: Saving data for UE74675: {'auction_closing_time': 1774714808.0, 'created_time': 1773837103.385773, 'last_price_update_time': 1774638025.446553}
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE74675') HTTP/1.1" 204 0
2026-03-27 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:25 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-27 19:00:25 [auto1.nl] INFO: Scrape type for LA17019: 2
2026-03-27 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-27 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with scrape type 2
2026-03-27 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with scrape type 2
2026-03-27 19:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16fa622e-c4cd-5e07-b1f2-5ca828e39398, identifier: LA17019
2026-03-27 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019
2026-03-27 19:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16fa622e-c4cd-5e07-b1f2-5ca828e39398 with identifier: LA17019 to the API
2026-03-27 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:49:56Z',
 'fuel_type': 'petrol',
 'id': '16fa622e-c4cd-5e07-b1f2-5ca828e39398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA17019',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 104876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2018}
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Saving data for LA17019: {'auction_closing_time': 1774716596.0, 'created_time': 1773132632.739229, 'last_price_update_time': 1774638027.221393}
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA17019') HTTP/1.1" 204 0
2026-03-27 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG41463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for WC04014: 1
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for VF61988: 1
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for EK85406: 1
2026-03-27 19:00:27 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AR13994/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-27 19:00:27 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-27 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-27 19:00:27 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA41421> (referer: https://www.auto1.com/v1/car-details-view/CA41421/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR13994> (referer: https://www.auto1.com/v1/car-details-view/AR13994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF61988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC04014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK85406/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef59919-6a46-5146-9036-a2e1bec66f21 with identifier: CA41421
2026-03-27 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef59919-6a46-5146-9036-a2e1bec66f21 with scrape type 1
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cef59919-6a46-5146-9036-a2e1bec66f21
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_08fd98572debf670e5f5eacdd88b2db2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_08fd98572debf670e5f5eacdd88b2db2.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_bc2687e8707ef4d43bb484b2f8bee6f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_bc2687e8707ef4d43bb484b2f8bee6f3.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_cd513b1dc6c6e2db88d4ed4f04e968ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_cd513b1dc6c6e2db88d4ed4f04e968ec.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_f73532ecf81082a49ccbb91bfdd49246.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_f73532ecf81082a49ccbb91bfdd49246.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_df290d91260ec7b506cfffa9ce3b9726.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_df290d91260ec7b506cfffa9ce3b9726.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_5ece1e57f451d4345392208df6b60b4e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_5ece1e57f451d4345392208df6b60b4e.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_ec74e71b17b0045ef9c6971a23734c0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_ec74e71b17b0045ef9c6971a23734c0d.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_8ae599f901f2a0ff9de90da234e1333f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_8ae599f901f2a0ff9de90da234e1333f.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_9daee93b55ee822e820e0076d14af13b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9daee93b55ee822e820e0076d14af13b.jpg already downloaded
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fcf%252F68cfaeef37f49c83f3b55791bd38b851%252Fpa%252FCA41421_9dedd825b5faaf53915127737db251b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9dedd825b5faaf53915127737db251b5.jpg already downloaded
2026-03-27 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cef59919-6a46-5146-9036-a2e1bec66f21, identifier: CA41421
2026-03-27 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cef59919-6a46-5146-9036-a2e1bec66f21 with identifier: CA41421
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cef59919-6a46-5146-9036-a2e1bec66f21 with identifier: CA41421
2026-03-27 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cef59919-6a46-5146-9036-a2e1bec66f21 with identifier: CA41421 to the API
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CA41421>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:36:57Z',
 'fuel_type': 'petrol',
 'id': 'cef59919-6a46-5146-9036-a2e1bec66f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Rt906r',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA41421',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 185284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_08fd98572debf670e5f5eacdd88b2db2.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_bc2687e8707ef4d43bb484b2f8bee6f3.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_cd513b1dc6c6e2db88d4ed4f04e968ec.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_f73532ecf81082a49ccbb91bfdd49246.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_df290d91260ec7b506cfffa9ce3b9726.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_5ece1e57f451d4345392208df6b60b4e.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_ec74e71b17b0045ef9c6971a23734c0d.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_8ae599f901f2a0ff9de90da234e1333f.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9daee93b55ee822e820e0076d14af13b.jpg',
                'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9dedd825b5faaf53915127737db251b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_08fd98572debf670e5f5eacdd88b2db2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_bc2687e8707ef4d43bb484b2f8bee6f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_cd513b1dc6c6e2db88d4ed4f04e968ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_f73532ecf81082a49ccbb91bfdd49246.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_df290d91260ec7b506cfffa9ce3b9726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_5ece1e57f451d4345392208df6b60b4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_ec74e71b17b0045ef9c6971a23734c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_8ae599f901f2a0ff9de90da234e1333f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9daee93b55ee822e820e0076d14af13b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef59919-6a46-5146-9036-a2e1bec66f21/cef59919-6a46-5146-9036-a2e1bec66f21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/cf/68cfaeef37f49c83f3b55791bd38b851/pa/CA41421_9dedd825b5faaf53915127737db251b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Turbo ON ecoFlex',
 'transmission': 'manual',
 'trim': 'ON ecoFlex',
 'year': 2018}
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-27 19:00:29 [auto1.nl] INFO: Saving data for CA41421: {'created_time': 1774638029.885325, 'last_price_update_time': 1774638029.885336, 'auction_closing_time': 1774715817.0}
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA41421') HTTP/1.1" 204 0
2026-03-27 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX02996> (referer: https://www.auto1.com/v1/car-details-view/BX02996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG41463> (referer: https://www.auto1.com/v1/car-details-view/CG41463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ae5808-450c-58fc-a259-92eb5bb647c3 with identifier: AR13994
2026-03-27 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ae5808-450c-58fc-a259-92eb5bb647c3 with scrape type 1
2026-03-27 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34ae5808-450c-58fc-a259-92eb5bb647c3
2026-03-27 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_5915b0ffeac6d73e2da8616a744c8ae4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_5915b0ffeac6d73e2da8616a744c8ae4.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_401bde47d965b794d54f979f669d0690.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_401bde47d965b794d54f979f669d0690.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_18c1f8a5def5adba1e7c6ea7b3e4bf8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_18c1f8a5def5adba1e7c6ea7b3e4bf8c.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_7468fd51969b034826ea7259e0e91151.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_7468fd51969b034826ea7259e0e91151.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_24d4e0a7460efec7a05891a5e20ce95b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_24d4e0a7460efec7a05891a5e20ce95b.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_f0f555d5053634f5631f3ac099fab0ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_f0f555d5053634f5631f3ac099fab0ab.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_1e224b04d3f954cd7f0a7eee5b190eea.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_1e224b04d3f954cd7f0a7eee5b190eea.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_552b4ee5d2943124800581947afa690c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_552b4ee5d2943124800581947afa690c.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_6b092b3f82000dca3441e705cbe8f61b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_6b092b3f82000dca3441e705cbe8f61b.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252F7b%252Fd97ba83c36ece39d4e6bfca9fba390fd%252Fpa%252FAR13994_9be0e45b0b113b0916b3bb089c52f315.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_9be0e45b0b113b0916b3bb089c52f315.jpg already downloaded
2026-03-27 19:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34ae5808-450c-58fc-a259-92eb5bb647c3, identifier: AR13994
2026-03-27 19:00:30 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34ae5808-450c-58fc-a259-92eb5bb647c3 with identifier: AR13994
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34ae5808-450c-58fc-a259-92eb5bb647c3 with identifier: AR13994
2026-03-27 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34ae5808-450c-58fc-a259-92eb5bb647c3 with identifier: AR13994 to the API
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR13994>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:04Z',
 'fuel_type': 'diesel',
 'id': '34ae5808-450c-58fc-a259-92eb5bb647c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HTL27L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR13994',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 149036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_5915b0ffeac6d73e2da8616a744c8ae4.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_401bde47d965b794d54f979f669d0690.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_18c1f8a5def5adba1e7c6ea7b3e4bf8c.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_7468fd51969b034826ea7259e0e91151.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_24d4e0a7460efec7a05891a5e20ce95b.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_f0f555d5053634f5631f3ac099fab0ab.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_1e224b04d3f954cd7f0a7eee5b190eea.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_552b4ee5d2943124800581947afa690c.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_6b092b3f82000dca3441e705cbe8f61b.jpg',
                'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_9be0e45b0b113b0916b3bb089c52f315.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_5915b0ffeac6d73e2da8616a744c8ae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_401bde47d965b794d54f979f669d0690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_18c1f8a5def5adba1e7c6ea7b3e4bf8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_7468fd51969b034826ea7259e0e91151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_24d4e0a7460efec7a05891a5e20ce95b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_f0f555d5053634f5631f3ac099fab0ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_1e224b04d3f954cd7f0a7eee5b190eea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_552b4ee5d2943124800581947afa690c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_6b092b3f82000dca3441e705cbe8f61b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34ae5808-450c-58fc-a259-92eb5bb647c3/34ae5808-450c-58fc-a259-92eb5bb647c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/7b/d97ba83c36ece39d4e6bfca9fba390fd/pa/AR13994_9be0e45b0b113b0916b3bb089c52f315.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [auto1.nl] INFO: Saving data for AR13994: {'created_time': 1774638030.717989, 'last_price_update_time': 1774638030.717999, 'auction_closing_time': 1774714384.0}
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AR13994') HTTP/1.1" 204 0
2026-03-27 19:00:30 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [auto1.nl] INFO: Scrape type for LF75031: 1
2026-03-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:30 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-27 19:00:30 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-27 19:00:30 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [auto1.nl] INFO: Scrape type for KV59291: 1
2026-03-27 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f76b2e-ee34-58cc-9e62-fac588db292b with identifier: BX02996
2026-03-27 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f76b2e-ee34-58cc-9e62-fac588db292b with scrape type 1
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2f76b2e-ee34-58cc-9e62-fac588db292b
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_e5e32769947a963dae287fb65d799ba3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_e5e32769947a963dae287fb65d799ba3.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_ea288980138096b1016f988fe3550589.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_ea288980138096b1016f988fe3550589.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_23568becfe7035d4ba15747508d73517.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_23568becfe7035d4ba15747508d73517.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_2835641840683142de3a64e0824ee591.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_2835641840683142de3a64e0824ee591.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_5314c43cf88ec41697085dd13994f87c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_5314c43cf88ec41697085dd13994f87c.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_587b08462b6bc55179294bb1d42d449b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_587b08462b6bc55179294bb1d42d449b.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_7908155defa8e7192daf800cb2ad69a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_7908155defa8e7192daf800cb2ad69a7.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_d0e9ffd85532d27ad92f86bb82b5fab0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_d0e9ffd85532d27ad92f86bb82b5fab0.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_17fb1c88ccdda332aa2bf8f09250cfa7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_17fb1c88ccdda332aa2bf8f09250cfa7.jpg already downloaded
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Ff9%252Fb9f9b3f4aef146c2a1e1a149e7774b22%252Fpa%252FBX02996_53ceb7bda6d922f496e06e7ce16e4ca4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_53ceb7bda6d922f496e06e7ce16e4ca4.jpg already downloaded
2026-03-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2f76b2e-ee34-58cc-9e62-fac588db292b, identifier: BX02996
2026-03-27 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48 with identifier: CG41463
2026-03-27 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48 with scrape type 1
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_c4473a59d72149637e26d18b473b182a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4473a59d72149637e26d18b473b182a.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_8e5826c49b3f574b07a9df5bbf68f726.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8e5826c49b3f574b07a9df5bbf68f726.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_a34359eaafd692431630dfd3c3d54cc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_a34359eaafd692431630dfd3c3d54cc6.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_6c89ea7cd27bd7b3ec0fec2ca1f82687.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_6c89ea7cd27bd7b3ec0fec2ca1f82687.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_c4c5146f8128d0d8880944e235f782f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4c5146f8128d0d8880944e235f782f5.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_8575a28d5f9b0b71eb9b8bca3be656af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8575a28d5f9b0b71eb9b8bca3be656af.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_d60a54bc8b0a2b3fcf20644ea4a63482.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d60a54bc8b0a2b3fcf20644ea4a63482.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_300796ed52c9b862f6070d795a764e51.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_300796ed52c9b862f6070d795a764e51.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_50e6b473c4204aba2452b17d9a581e11.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_50e6b473c4204aba2452b17d9a581e11.jpg already downloaded
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fa4%252F78a4badb020b350893a5fc3f7cca65cc%252Fpa%252FCG41463_d12de64fe257b986a7ff6bca99bec232.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d12de64fe257b986a7ff6bca99bec232.jpg already downloaded
2026-03-27 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48, identifier: CG41463
2026-03-27 19:00:31 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-27 19:00:31 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-27 19:00:31 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [auto1.nl] INFO: Scrape type for NZ11721: 1
2026-03-27 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2f76b2e-ee34-58cc-9e62-fac588db292b with identifier: BX02996
2026-03-27 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2f76b2e-ee34-58cc-9e62-fac588db292b with identifier: BX02996
2026-03-27 19:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2f76b2e-ee34-58cc-9e62-fac588db292b with identifier: BX02996 to the API
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX02996>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:46Z',
 'fuel_type': 'diesel',
 'id': 'c2f76b2e-ee34-58cc-9e62-fac588db292b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '84VVX2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX02996',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 289551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_e5e32769947a963dae287fb65d799ba3.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_ea288980138096b1016f988fe3550589.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_23568becfe7035d4ba15747508d73517.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_2835641840683142de3a64e0824ee591.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_5314c43cf88ec41697085dd13994f87c.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_587b08462b6bc55179294bb1d42d449b.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_7908155defa8e7192daf800cb2ad69a7.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_d0e9ffd85532d27ad92f86bb82b5fab0.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_17fb1c88ccdda332aa2bf8f09250cfa7.jpg',
                'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_53ceb7bda6d922f496e06e7ce16e4ca4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_e5e32769947a963dae287fb65d799ba3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_ea288980138096b1016f988fe3550589.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_23568becfe7035d4ba15747508d73517.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_2835641840683142de3a64e0824ee591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_5314c43cf88ec41697085dd13994f87c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_587b08462b6bc55179294bb1d42d449b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_7908155defa8e7192daf800cb2ad69a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_d0e9ffd85532d27ad92f86bb82b5fab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_17fb1c88ccdda332aa2bf8f09250cfa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2f76b2e-ee34-58cc-9e62-fac588db292b/c2f76b2e-ee34-58cc-9e62-fac588db292b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/f9/b9f9b3f4aef146c2a1e1a149e7774b22/pa/BX02996_53ceb7bda6d922f496e06e7ce16e4ca4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-16',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Ambiente',
 'transmission': 'manual',
 'trim': 'kompakt Ambiente',
 'year': 2008}
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-27 19:00:31 [auto1.nl] INFO: Saving data for BX02996: {'created_time': 1774638031.871973, 'last_price_update_time': 1774638031.871984, 'auction_closing_time': 1774715926.0}
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX02996') HTTP/1.1" 204 0
2026-03-27 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48 with identifier: CG41463
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48 with identifier: CG41463
2026-03-27 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48 with identifier: CG41463 to the API
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG41463>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 167,
 'expiration_date': '2026-03-28T16:38:34Z',
 'fuel_type': 'petrol',
 'id': '4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '03SKZ6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG41463',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 148341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4473a59d72149637e26d18b473b182a.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8e5826c49b3f574b07a9df5bbf68f726.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_a34359eaafd692431630dfd3c3d54cc6.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_6c89ea7cd27bd7b3ec0fec2ca1f82687.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4c5146f8128d0d8880944e235f782f5.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8575a28d5f9b0b71eb9b8bca3be656af.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d60a54bc8b0a2b3fcf20644ea4a63482.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_300796ed52c9b862f6070d795a764e51.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_50e6b473c4204aba2452b17d9a581e11.jpg',
                'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d12de64fe257b986a7ff6bca99bec232.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4473a59d72149637e26d18b473b182a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8e5826c49b3f574b07a9df5bbf68f726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_a34359eaafd692431630dfd3c3d54cc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_6c89ea7cd27bd7b3ec0fec2ca1f82687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_c4c5146f8128d0d8880944e235f782f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_8575a28d5f9b0b71eb9b8bca3be656af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d60a54bc8b0a2b3fcf20644ea4a63482.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_300796ed52c9b862f6070d795a764e51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_50e6b473c4204aba2452b17d9a581e11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48/4e531d99-aa1e-5b07-a0b1-d08ae6a6ed48_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/a4/78a4badb020b350893a5fc3f7cca65cc/pa/CG41463_d12de64fe257b986a7ff6bca99bec232.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Antara 2.4 Design Edition 4x2',
 'transmission': 'manual',
 'trim': 'Design Edition 4x2',
 'year': 2011}
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Saving data for CG41463: {'created_time': 1774638032.297537, 'last_price_update_time': 1774638032.297547, 'auction_closing_time': 1774715914.0}
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CG41463') HTTP/1.1" 204 0
2026-03-27 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Scrape type for YS44884: 0
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Scrape type for UR86175: 2
2026-03-27 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-27 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with scrape type 2
2026-03-27 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with scrape type 2
2026-03-27 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5ed5d71e-7e78-5c49-a860-6eb7b1631726, identifier: UR86175
2026-03-27 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-27 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175
2026-03-27 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5ed5d71e-7e78-5c49-a860-6eb7b1631726 with identifier: UR86175 to the API
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:47:20Z',
 'fuel_type': 'petrol',
 'id': '5ed5d71e-7e78-5c49-a860-6eb7b1631726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR86175',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 373330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Conceptline',
 'transmission': 'manual',
 'trim': 'Conceptline',
 'year': 2010}
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Saving data for UR86175: {'auction_closing_time': 1774716440.0, 'created_time': 1773688228.524471, 'last_price_update_time': 1774638032.741402}
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UR86175') HTTP/1.1" 204 0
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Scrape type for ED59845: 0
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-27 19:00:32 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-27 19:00:32 [auto1.nl] INFO: Scrape type for SD39656: 2
2026-03-27 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df47a185-70d8-5e31-9043-e2df04d23b71 with identifier: SD39656
2026-03-27 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df47a185-70d8-5e31-9043-e2df04d23b71 with scrape type 2
2026-03-27 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df47a185-70d8-5e31-9043-e2df04d23b71 with scrape type 2
2026-03-27 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df47a185-70d8-5e31-9043-e2df04d23b71, identifier: SD39656
2026-03-27 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df47a185-70d8-5e31-9043-e2df04d23b71 with identifier: SD39656
2026-03-27 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df47a185-70d8-5e31-9043-e2df04d23b71 with identifier: SD39656
2026-03-27 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df47a185-70d8-5e31-9043-e2df04d23b71 with identifier: SD39656 to the API
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'diesel',
 'id': 'df47a185-70d8-5e31-9043-e2df04d23b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD39656',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 122935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Rapid Maxi Extra',
 'transmission': 'manual',
 'trim': 'Rapid Maxi Extra',
 'year': 2018}
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Saving data for SD39656: {'auction_closing_time': 1774714568.0, 'created_time': 1774440108.75723, 'last_price_update_time': 1774638033.358095}
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD39656') HTTP/1.1" 204 0
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Scrape type for DA17330: 0
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Scrape type for GA05511: 2
2026-03-27 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with identifier: GA05511
2026-03-27 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with scrape type 2
2026-03-27 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with scrape type 2
2026-03-27 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5, identifier: GA05511
2026-03-27 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with identifier: GA05511
2026-03-27 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with identifier: GA05511
2026-03-27 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5 with identifier: GA05511 to the API
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:04:08Z',
 'fuel_type': 'petrol',
 'id': 'a79a885c-ef1a-5fe2-a432-b8ac7ed5b0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA05511',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 157589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-23',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Saving data for GA05511: {'auction_closing_time': 1774713848.0, 'created_time': 1774440050.470511, 'last_price_update_time': 1774638033.770948}
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA05511') HTTP/1.1" 204 0
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Scrape type for NR95179: 0
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Scrape type for WS89953: 0
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-27 19:00:33 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-27 19:00:33 [auto1.nl] INFO: Scrape type for AA68968: 2
2026-03-27 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad69f970-5d8b-5610-a3fd-128dfcf79be5 with identifier: AA68968
2026-03-27 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad69f970-5d8b-5610-a3fd-128dfcf79be5 with scrape type 2
2026-03-27 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad69f970-5d8b-5610-a3fd-128dfcf79be5 with scrape type 2
2026-03-27 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad69f970-5d8b-5610-a3fd-128dfcf79be5, identifier: AA68968
2026-03-27 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad69f970-5d8b-5610-a3fd-128dfcf79be5 with identifier: AA68968
2026-03-27 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad69f970-5d8b-5610-a3fd-128dfcf79be5 with identifier: AA68968
2026-03-27 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad69f970-5d8b-5610-a3fd-128dfcf79be5 with identifier: AA68968 to the API
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:17:29Z',
 'fuel_type': 'petrol',
 'id': 'ad69f970-5d8b-5610-a3fd-128dfcf79be5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA68968',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 261230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-11',
 'seller_name': None,
 'title': 'Seat Altea 1.6 Reference Comfort',
 'transmission': 'manual',
 'trim': 'Reference Comfort',
 'year': 2008}
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Saving data for AA68968: {'auction_closing_time': 1774714649.0, 'created_time': 1774440101.421029, 'last_price_update_time': 1774638034.241437}
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AA68968') HTTP/1.1" 204 0
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-27 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK85406> (referer: https://www.auto1.com/v1/car-details-view/EK85406/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF75031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF61988> (referer: https://www.auto1.com/v1/car-details-view/VF61988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:34 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-27 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40365f6a-9594-580b-8100-df4e29dc5945 with scrape type 1
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg not downloaded yet
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Scrape type for MU53685: 2
2026-03-27 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-27 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6216bfca-7290-5e92-9d40-7f8f23485812 with scrape type 2
2026-03-27 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6216bfca-7290-5e92-9d40-7f8f23485812, identifier: MU53685
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_41bb934351eb2636b95fef88f8cab50d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_41bb934351eb2636b95fef88f8cab50d.jpg not downloaded yet
2026-03-27 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-27 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685
2026-03-27 19:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6216bfca-7290-5e92-9d40-7f8f23485812 with identifier: MU53685 to the API
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'petrol',
 'id': '6216bfca-7290-5e92-9d40-7f8f23485812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU53685',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 246019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'BMW 3er 320i EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2014}
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Saving data for MU53685: {'auction_closing_time': 1774715117.0, 'created_time': 1774551631.379615, 'last_price_update_time': 1774638034.873596}
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU53685') HTTP/1.1" 204 0
2026-03-27 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Scrape type for LL90951: 1
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg not downloaded yet
2026-03-27 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC04014> (referer: https://www.auto1.com/v1/car-details-view/WC04014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-27 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d9cc7d2-3682-536e-a507-90192b8e10ac with scrape type 1
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_1ca3ddb66e228426eda40f4d6be19041.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_1ca3ddb66e228426eda40f4d6be19041.jpg not downloaded yet
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-27 19:00:34 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-27 19:00:34 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [auto1.nl] INFO: Scrape type for AY12537: 0
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [auto1.nl] INFO: Scrape type for SA56403: 2
2026-03-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e15b756f-ae5d-58c7-9e94-ffc49a994a37 with identifier: SA56403
2026-03-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e15b756f-ae5d-58c7-9e94-ffc49a994a37 with scrape type 2
2026-03-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e15b756f-ae5d-58c7-9e94-ffc49a994a37 with scrape type 2
2026-03-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e15b756f-ae5d-58c7-9e94-ffc49a994a37, identifier: SA56403
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_09e351b345efed6e5bc2625c628315f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_09e351b345efed6e5bc2625c628315f8.jpg not downloaded yet
2026-03-27 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e15b756f-ae5d-58c7-9e94-ffc49a994a37 with identifier: SA56403
2026-03-27 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e15b756f-ae5d-58c7-9e94-ffc49a994a37 with identifier: SA56403
2026-03-27 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e15b756f-ae5d-58c7-9e94-ffc49a994a37 with identifier: SA56403 to the API
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:32:39Z',
 'fuel_type': 'petrol',
 'id': 'e15b756f-ae5d-58c7-9e94-ffc49a994a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA56403',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 120159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-06',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [auto1.nl] INFO: Saving data for SA56403: {'auction_closing_time': 1774715559.0, 'created_time': 1774440086.394085, 'last_price_update_time': 1774638035.478413}
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA56403') HTTP/1.1" 204 0
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_7ccc54055a22968a35a518a98387e42a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7ccc54055a22968a35a518a98387e42a.jpg not downloaded yet
2026-03-27 19:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:35 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [auto1.nl] INFO: Scrape type for CP01462: 2
2026-03-27 19:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with identifier: CP01462
2026-03-27 19:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with scrape type 2
2026-03-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with scrape type 2
2026-03-27 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa5f9f02-8d98-569a-b5ba-baa38e1ed31b, identifier: CP01462
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_149009a00fd5d900dcb291fbb75478da.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_149009a00fd5d900dcb291fbb75478da.jpg not downloaded yet
2026-03-27 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with identifier: CP01462
2026-03-27 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with identifier: CP01462
2026-03-27 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa5f9f02-8d98-569a-b5ba-baa38e1ed31b with identifier: CP01462 to the API
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:40:46Z',
 'fuel_type': 'petrol',
 'id': 'fa5f9f02-8d98-569a-b5ba-baa38e1ed31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP01462',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Spacetourer',
 'odometer': 122474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Citroen C4 Spacetourer 1.2 PureTech Origins',
 'transmission': 'manual',
 'trim': 'Origins',
 'year': 2019}
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Saving data for CP01462: {'auction_closing_time': 1774716046.0, 'created_time': 1774440041.228411, 'last_price_update_time': 1774638036.013579}
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP01462') HTTP/1.1" 204 0
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_28955006536517eac68f31c50745a26e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_28955006536517eac68f31c50745a26e.jpg not downloaded yet
2026-03-27 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV59291/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ11721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-27 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df82903a-4b4d-55ca-88fd-43bf61db3cb7 with scrape type 1
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg not downloaded yet
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM76247%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for ZM76247: 1
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_6095f39a179f65d50b9e12e928b60e89.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_6095f39a179f65d50b9e12e928b60e89.jpg not downloaded yet
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_b342be52aa23bda0c88665742345dc35.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_b342be52aa23bda0c88665742345dc35.jpg not downloaded yet
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_89f055a86661a321f373b8cdfc878a7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_89f055a86661a321f373b8cdfc878a7b.jpg not downloaded yet
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for FT93592: 2
2026-03-27 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-27 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-27 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 50da3f30-d841-5fb5-a493-8e3e1c5feb15, identifier: FT93592
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_00942149d47869160de3fc7f10be9250.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00942149d47869160de3fc7f10be9250.jpg not downloaded yet
2026-03-27 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-27 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-27 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592 to the API
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': '50da3f30-d841-5fb5-a493-8e3e1c5feb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT93592',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 143606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-07',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L4 Heavy BlueHDi',
 'transmission': 'manual',
 'trim': '35 L4 Heavy BlueHDi',
 'year': 2018}
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Saving data for FT93592: {'auction_closing_time': 1774715192.0, 'created_time': 1773132799.005079, 'last_price_update_time': 1774638036.637892}
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FT93592') HTTP/1.1" 204 0
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_234c8b8e207bcb1c139040e925414913.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_234c8b8e207bcb1c139040e925414913.jpg not downloaded yet
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_21e010dc8525ad2a1599daf2a296129a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_21e010dc8525ad2a1599daf2a296129a.jpg not downloaded yet
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for YF39374: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for KB15106: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for XG69964: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for YU59495: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for CW75343: 1
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_1dcfdd316076896f3015a857be7aed3a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_1dcfdd316076896f3015a857be7aed3a.jpg not downloaded yet
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_370dc4aadba712e9b523f9a6deeffa10.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_370dc4aadba712e9b523f9a6deeffa10.jpg not downloaded yet
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg not downloaded yet
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for EA94129: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for JR01730: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for JJ61661: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for YK25571: 0
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-27 19:00:36 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-27 19:00:36 [auto1.nl] INFO: Scrape type for NU05681: 2
2026-03-27 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-27 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with scrape type 2
2026-03-27 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with scrape type 2
2026-03-27 19:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9, identifier: NU05681
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg not downloaded yet
2026-03-27 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681
2026-03-27 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b4d84eff-4fa8-57f9-a1b2-a01d24790cf9 with identifier: NU05681 to the API
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'petrol',
 'id': 'b4d84eff-4fa8-57f9-a1b2-a01d24790cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU05681',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 217220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Style 2WD',
 'transmission': 'automatic',
 'trim': 'Style 2WD',
 'year': 2010}
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [auto1.nl] INFO: Saving data for NU05681: {'auction_closing_time': 1774714484.0, 'created_time': 1774008063.691086, 'last_price_update_time': 1774638037.540393}
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU05681') HTTP/1.1" 204 0
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_687db7865cf983fbd581efcd50091e73.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_687db7865cf983fbd581efcd50091e73.jpg not downloaded yet
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg not downloaded yet
2026-03-27 19:00:37 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [auto1.nl] INFO: Scrape type for CH03360: 0
2026-03-27 19:00:37 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [auto1.nl] INFO: Scrape type for NR57871: 0
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg not downloaded yet
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_41bb934351eb2636b95fef88f8cab50d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_5a83293aa10fb25117d011b79a2717fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_5a83293aa10fb25117d011b79a2717fb.jpg not downloaded yet
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_1977268f78b500309e0d3e65457a3894.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_1977268f78b500309e0d3e65457a3894.jpg not downloaded yet
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF75031> (referer: https://www.auto1.com/v1/car-details-view/LF75031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_1ca3ddb66e228426eda40f4d6be19041.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg not downloaded yet
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_7fdea6eb3689efb260456bdce28bd558.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7fdea6eb3689efb260456bdce28bd558.jpg not downloaded yet
2026-03-27 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_09e351b345efed6e5bc2625c628315f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 19:00:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 19:00:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca336d0>
2026-03-27 19:00:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg saved to cache
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb7cc90>
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_41bb934351eb2636b95fef88f8cab50d.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_41bb934351eb2636b95fef88f8cab50d.jpg saved to cache
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_28955006536517eac68f31c50745a26e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_89f055a86661a321f373b8cdfc878a7b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_6095f39a179f65d50b9e12e928b60e89.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00942149d47869160de3fc7f10be9250.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:38 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-27 19:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75e2fd9-74f2-5434-b24d-766a89eebb30 with scrape type 1
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d75e2fd9-74f2-5434-b24d-766a89eebb30
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_183b9b67f862fe03d5e5376245092393.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_183b9b67f862fe03d5e5376245092393.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_3dc70bcf00fd6496c993ff63c0f16523.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_3dc70bcf00fd6496c993ff63c0f16523.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_f540d7a536fdcdd3e125b85300003b98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_f540d7a536fdcdd3e125b85300003b98.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_2bfde4f85ac1a1f1309d4a2abffac7e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_2bfde4f85ac1a1f1309d4a2abffac7e4.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_782d5bee99df97d21c2a11a03de40c80.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_782d5bee99df97d21c2a11a03de40c80.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_375d29451dee5ddc7398c786d80452af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_375d29451dee5ddc7398c786d80452af.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_d16ae548b3b7e97ef986a55b17dc3669.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_d16ae548b3b7e97ef986a55b17dc3669.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_a3a25fa21e5ce60e06c75e50342b58da.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a3a25fa21e5ce60e06c75e50342b58da.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_be2f277a49c5654fdd6a60e343691195.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_be2f277a49c5654fdd6a60e343691195.jpg already downloaded
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F85%252F2c856c916d3102106a6f43711de07553%252Fpa%252FLF75031_a1f78bb768f7a7b18be7f740275b4821.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a1f78bb768f7a7b18be7f740275b4821.jpg already downloaded
2026-03-27 19:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d75e2fd9-74f2-5434-b24d-766a89eebb30, identifier: LF75031
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff19910>
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_1ca3ddb66e228426eda40f4d6be19041.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_1ca3ddb66e228426eda40f4d6be19041.jpg saved to cache
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb48290>
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_09e351b345efed6e5bc2625c628315f8.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_09e351b345efed6e5bc2625c628315f8.jpg saved to cache
2026-03-27 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-27 19:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031
2026-03-27 19:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d75e2fd9-74f2-5434-b24d-766a89eebb30 with identifier: LF75031 to the API
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF75031>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:20:24Z',
 'fuel_type': 'petrol',
 'id': 'd75e2fd9-74f2-5434-b24d-766a89eebb30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RG307R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF75031',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '3er',
 'odometer': 144832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_183b9b67f862fe03d5e5376245092393.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_3dc70bcf00fd6496c993ff63c0f16523.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_f540d7a536fdcdd3e125b85300003b98.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_2bfde4f85ac1a1f1309d4a2abffac7e4.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_782d5bee99df97d21c2a11a03de40c80.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_375d29451dee5ddc7398c786d80452af.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_d16ae548b3b7e97ef986a55b17dc3669.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a3a25fa21e5ce60e06c75e50342b58da.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_be2f277a49c5654fdd6a60e343691195.jpg',
                'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a1f78bb768f7a7b18be7f740275b4821.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325710,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_183b9b67f862fe03d5e5376245092393.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 361028,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_3dc70bcf00fd6496c993ff63c0f16523.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369002,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_f540d7a536fdcdd3e125b85300003b98.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 291459,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_2bfde4f85ac1a1f1309d4a2abffac7e4.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_782d5bee99df97d21c2a11a03de40c80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 388946,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_375d29451dee5ddc7398c786d80452af.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 365177,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_d16ae548b3b7e97ef986a55b17dc3669.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369219,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a3a25fa21e5ce60e06c75e50342b58da.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 320162,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_be2f277a49c5654fdd6a60e343691195.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d75e2fd9-74f2-5434-b24d-766a89eebb30/d75e2fd9-74f2-5434-b24d-766a89eebb30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/85/2c856c916d3102106a6f43711de07553/pa/LF75031_a1f78bb768f7a7b18be7f740275b4821.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Saving data for LF75031: {'created_time': 1774638038.873056, 'last_price_update_time': 1774638038.87307, 'auction_closing_time': 1774714824.0}
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF75031') HTTP/1.1" 204 0
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_687db7865cf983fbd581efcd50091e73.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Scrape type for KZ79748: 0
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Scrape type for XY38299: 0
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Scrape type for TD45630: 0
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Scrape type for GS00430: 0
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-27 19:00:38 [auto1.nl] INFO: Scrape type for VS32339: 0
2026-03-27 19:00:38 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-27 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for FH26666: 0
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for ZT03654: 2
2026-03-27 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c94c2a2-5862-500f-b787-523d61836060 with identifier: ZT03654
2026-03-27 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c94c2a2-5862-500f-b787-523d61836060 with scrape type 2
2026-03-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c94c2a2-5862-500f-b787-523d61836060 with scrape type 2
2026-03-27 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c94c2a2-5862-500f-b787-523d61836060, identifier: ZT03654
2026-03-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_1977268f78b500309e0d3e65457a3894.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c94c2a2-5862-500f-b787-523d61836060 with identifier: ZT03654
2026-03-27 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c94c2a2-5862-500f-b787-523d61836060 with identifier: ZT03654
2026-03-27 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c94c2a2-5862-500f-b787-523d61836060 with identifier: ZT03654 to the API
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': '3c94c2a2-5862-500f-b787-523d61836060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT03654',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 159933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2016}
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Saving data for ZT03654: {'auction_closing_time': 1774716349.0, 'created_time': 1774440052.521412, 'last_price_update_time': 1774638039.459377}
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZT03654') HTTP/1.1" 204 0
2026-03-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM76247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_5a83293aa10fb25117d011b79a2717fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:39 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-27 19:00:39 [auto1.nl] INFO: Scrape type for EZ41839: 2
2026-03-27 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da005e89-9cff-5086-b1fe-883f43edc179 with identifier: EZ41839
2026-03-27 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da005e89-9cff-5086-b1fe-883f43edc179 with scrape type 2
2026-03-27 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da005e89-9cff-5086-b1fe-883f43edc179 with scrape type 2
2026-03-27 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: da005e89-9cff-5086-b1fe-883f43edc179, identifier: EZ41839
2026-03-27 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: da005e89-9cff-5086-b1fe-883f43edc179 with identifier: EZ41839
2026-03-27 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: da005e89-9cff-5086-b1fe-883f43edc179 with identifier: EZ41839
2026-03-27 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: da005e89-9cff-5086-b1fe-883f43edc179 with identifier: EZ41839 to the API
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:32:12Z',
 'fuel_type': 'petrol',
 'id': 'da005e89-9cff-5086-b1fe-883f43edc179',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ41839',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 215376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-27 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-27 19:00:40 [auto1.nl] INFO: Saving data for EZ41839: {'auction_closing_time': 1774715532.0, 'created_time': 1774440084.27629, 'last_price_update_time': 1774638040.004769}
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EZ41839') HTTP/1.1" 204 0
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca602d0>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd4b790>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_28955006536517eac68f31c50745a26e.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_28955006536517eac68f31c50745a26e.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd567d0>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_89f055a86661a321f373b8cdfc878a7b.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_89f055a86661a321f373b8cdfc878a7b.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd5a690>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_6095f39a179f65d50b9e12e928b60e89.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_6095f39a179f65d50b9e12e928b60e89.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd6f910>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_00942149d47869160de3fc7f10be9250.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00942149d47869160de3fc7f10be9250.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cee10>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c97f690>
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_687db7865cf983fbd581efcd50091e73.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_687db7865cf983fbd581efcd50091e73.jpg saved to cache
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-27 19:00:40 [auto1.nl] INFO: Scrape type for GT38970: 0
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-27 19:00:40 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-27 19:00:40 [auto1.nl] INFO: Scrape type for DV35318: 0
2026-03-27 19:00:40 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-27 19:00:40 [auto1.nl] INFO: Scrape type for PB89826: 2
2026-03-27 19:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-27 19:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-27 19:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0924e34c-8623-57d1-a916-c0a2513425a4 with scrape type 2
2026-03-27 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0924e34c-8623-57d1-a916-c0a2513425a4, identifier: PB89826
2026-03-27 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-27 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826
2026-03-27 19:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0924e34c-8623-57d1-a916-c0a2513425a4 with identifier: PB89826 to the API
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-28T16:09:32Z',
 'fuel_type': 'hybrid',
 'id': '0924e34c-8623-57d1-a916-c0a2513425a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB89826',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 82924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2022}
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Saving data for PB89826: {'auction_closing_time': 1774714172.0, 'created_time': 1774353790.407247, 'last_price_update_time': 1774638050.798601}
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PB89826') HTTP/1.1" 204 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for KR09014: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for BZ17478: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for GJ53353: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for FA42645: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for ZZ83139: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for HT16373: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-27 19:00:50 [auto1.nl] INFO: Scrape type for VX18772: 0
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-27 19:00:50 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-27 19:00:51 [auto1.nl] INFO: Scrape type for JX76832: 1
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb4c050>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_1977268f78b500309e0d3e65457a3894.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_1977268f78b500309e0d3e65457a3894.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff671d0>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff752d0>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_5a83293aa10fb25117d011b79a2717fb.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_5a83293aa10fb25117d011b79a2717fb.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_370dc4aadba712e9b523f9a6deeffa10.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_21e010dc8525ad2a1599daf2a296129a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_1dcfdd316076896f3015a857be7aed3a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_234c8b8e207bcb1c139040e925414913.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:51 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-27 19:00:51 [auto1.nl] INFO: Scrape type for LN57581: 2
2026-03-27 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d48d0a-bb95-5586-b16b-bc2dde17f29a with identifier: LN57581
2026-03-27 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d48d0a-bb95-5586-b16b-bc2dde17f29a with scrape type 2
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d48d0a-bb95-5586-b16b-bc2dde17f29a with scrape type 2
2026-03-27 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65d48d0a-bb95-5586-b16b-bc2dde17f29a, identifier: LN57581
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL90951/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65d48d0a-bb95-5586-b16b-bc2dde17f29a with identifier: LN57581
2026-03-27 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65d48d0a-bb95-5586-b16b-bc2dde17f29a with identifier: LN57581
2026-03-27 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65d48d0a-bb95-5586-b16b-bc2dde17f29a with identifier: LN57581 to the API
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 63,
 'expiration_date': '2026-03-28T16:05:15Z',
 'fuel_type': 'petrol',
 'id': '65d48d0a-bb95-5586-b16b-bc2dde17f29a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN57581',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Atos',
 'odometer': 77148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-24',
 'seller_name': None,
 'title': 'Hyundai Atos 1.1',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-27 19:00:51 [auto1.nl] INFO: Saving data for LN57581: {'auction_closing_time': 1774713915.0, 'created_time': 1774440028.756606, 'last_price_update_time': 1774638051.591024}
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LN57581') HTTP/1.1" 204 0
2026-03-27 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8ca250>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd47190>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd45550>
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg saved to cache
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:51 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-27 19:00:51 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-27 19:00:51 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-27 19:00:51 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-27 19:00:51 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-27 19:00:51 [auto1.nl] INFO: Scrape type for MC36011: 2
2026-03-27 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 270b8f84-200d-57bc-9250-4602a719456b with identifier: MC36011
2026-03-27 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 270b8f84-200d-57bc-9250-4602a719456b with scrape type 2
2026-03-27 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 270b8f84-200d-57bc-9250-4602a719456b with scrape type 2
2026-03-27 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 270b8f84-200d-57bc-9250-4602a719456b, identifier: MC36011
2026-03-27 19:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_b342be52aa23bda0c88665742345dc35.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 270b8f84-200d-57bc-9250-4602a719456b with identifier: MC36011
2026-03-27 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 270b8f84-200d-57bc-9250-4602a719456b with identifier: MC36011
2026-03-27 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 270b8f84-200d-57bc-9250-4602a719456b with identifier: MC36011 to the API
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:39:05Z',
 'fuel_type': 'hybrid',
 'id': '270b8f84-200d-57bc-9250-4602a719456b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC36011',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 182706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2015}
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-27 19:00:52 [auto1.nl] INFO: Saving data for MC36011: {'auction_closing_time': 1774715945.0, 'created_time': 1774440049.664908, 'last_price_update_time': 1774638052.236198}
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MC36011') HTTP/1.1" 204 0
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd99510>
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_370dc4aadba712e9b523f9a6deeffa10.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_370dc4aadba712e9b523f9a6deeffa10.jpg saved to cache
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9c7110>
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F45%252Ff345d50b116b9565f04045357547910f%252Fpa%252FWC04014_21e010dc8525ad2a1599daf2a296129a.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_21e010dc8525ad2a1599daf2a296129a.jpg saved to cache
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df82903a-4b4d-55ca-88fd-43bf61db3cb7
2026-03-27 19:00:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df82903a-4b4d-55ca-88fd-43bf61db3cb7, skipping ID generation
2026-03-27 19:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df82903a-4b4d-55ca-88fd-43bf61db3cb7 with scrape type 1
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df82903a-4b4d-55ca-88fd-43bf61db3cb7 sending to next pipeline
2026-03-27 19:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df82903a-4b4d-55ca-88fd-43bf61db3cb7, identifier: WC04014
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb34190>
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_1dcfdd316076896f3015a857be7aed3a.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_1dcfdd316076896f3015a857be7aed3a.jpg saved to cache
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffc41d0>
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_234c8b8e207bcb1c139040e925414913.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_234c8b8e207bcb1c139040e925414913.jpg saved to cache
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:52 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-27 19:00:52 [auto1.nl] INFO: Scrape type for WR79727: 0
2026-03-27 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-27 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014
2026-03-27 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df82903a-4b4d-55ca-88fd-43bf61db3cb7 with identifier: WC04014 to the API
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_21e010dc8525ad2a1599daf2a296129a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:31:40Z',
 'fuel_type': 'diesel',
 'id': 'df82903a-4b4d-55ca-88fd-43bf61db3cb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4-ZLR-20',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC04014',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 196011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_c328ac6fb79f49e6425e9599797d4fa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_89f055a86661a321f373b8cdfc878a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_21e010dc8525ad2a1599daf2a296129a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_74760b7933f1bfa2ab904ac419dbdbc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_a86e9987226f94fd7b63e79d9eb18d0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df82903a-4b4d-55ca-88fd-43bf61db3cb7/df82903a-4b4d-55ca-88fd-43bf61db3cb7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/45/f345d50b116b9565f04045357547910f/pa/WC04014_1977268f78b500309e0d3e65457a3894.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-27 19:00:52 [auto1.nl] INFO: Saving data for WC04014: {'created_time': 1774638052.87559, 'last_price_update_time': 1774638052.875601, 'auction_closing_time': 1774715500.0}
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC04014') HTTP/1.1" 204 0
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW75343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdc4890>
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_b342be52aa23bda0c88665742345dc35.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_b342be52aa23bda0c88665742345dc35.jpg saved to cache
2026-03-27 19:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ11721> (referer: https://www.auto1.com/v1/car-details-view/NZ11721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7ccc54055a22968a35a518a98387e42a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_149009a00fd5d900dcb291fbb75478da.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7fdea6eb3689efb260456bdce28bd558.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-27 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8072fe1-ae28-5bee-952c-633e35a4d98b with scrape type 1
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8072fe1-ae28-5bee-952c-633e35a4d98b
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_2635366ddcc1e9715b2deea701c37264.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_2635366ddcc1e9715b2deea701c37264.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_0e93e2d90d0d62f4ca04d27dfffc818d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_0e93e2d90d0d62f4ca04d27dfffc818d.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_7763e89898d3e693fdae3cf13ab16089.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_7763e89898d3e693fdae3cf13ab16089.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_821a62c53df0da61e8f42c6eb6e8dc57.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_821a62c53df0da61e8f42c6eb6e8dc57.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_4e8d161d0950ebb56b913ba755a9f5b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_4e8d161d0950ebb56b913ba755a9f5b0.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_a9265edc04678a8ac3e0fc2b38d7d6db.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_a9265edc04678a8ac3e0fc2b38d7d6db.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_c465695bed15e9548a964a0d640175bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_c465695bed15e9548a964a0d640175bc.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_5323afe33c3d0ec4df01b367238b9397.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_5323afe33c3d0ec4df01b367238b9397.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_737a2bef32ece2840383cc4224efa4b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_737a2bef32ece2840383cc4224efa4b9.jpg already downloaded
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F2d%252Fe32dad926852a09a4190800e9ad11c65%252Fpa%252FNZ11721_af733f8dd8073cd09927d7c9003319f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_af733f8dd8073cd09927d7c9003319f7.jpg already downloaded
2026-03-27 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d8072fe1-ae28-5bee-952c-633e35a4d98b, identifier: NZ11721
2026-03-27 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-27 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721
2026-03-27 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d8072fe1-ae28-5bee-952c-633e35a4d98b with identifier: NZ11721 to the API
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ11721>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:49:47Z',
 'fuel_type': 'petrol',
 'id': 'd8072fe1-ae28-5bee-952c-633e35a4d98b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TB217R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ11721',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_2635366ddcc1e9715b2deea701c37264.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_0e93e2d90d0d62f4ca04d27dfffc818d.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_7763e89898d3e693fdae3cf13ab16089.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_821a62c53df0da61e8f42c6eb6e8dc57.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_4e8d161d0950ebb56b913ba755a9f5b0.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_a9265edc04678a8ac3e0fc2b38d7d6db.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_c465695bed15e9548a964a0d640175bc.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_5323afe33c3d0ec4df01b367238b9397.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_737a2bef32ece2840383cc4224efa4b9.jpg',
                'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_af733f8dd8073cd09927d7c9003319f7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_2635366ddcc1e9715b2deea701c37264.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_0e93e2d90d0d62f4ca04d27dfffc818d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_7763e89898d3e693fdae3cf13ab16089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_821a62c53df0da61e8f42c6eb6e8dc57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_4e8d161d0950ebb56b913ba755a9f5b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_a9265edc04678a8ac3e0fc2b38d7d6db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_c465695bed15e9548a964a0d640175bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_5323afe33c3d0ec4df01b367238b9397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_737a2bef32ece2840383cc4224efa4b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8072fe1-ae28-5bee-952c-633e35a4d98b/d8072fe1-ae28-5bee-952c-633e35a4d98b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/2d/e32dad926852a09a4190800e9ad11c65/pa/NZ11721_af733f8dd8073cd09927d7c9003319f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-27 19:00:53 [auto1.nl] INFO: Saving data for NZ11721: {'created_time': 1774638053.692116, 'last_price_update_time': 1774638053.692129, 'auction_closing_time': 1774716587.0}
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ11721') HTTP/1.1" 204 0
2026-03-27 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV59291> (referer: https://www.auto1.com/v1/car-details-view/KV59291/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb10790>
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg saved to cache
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd5bed0>
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_7ccc54055a22968a35a518a98387e42a.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7ccc54055a22968a35a518a98387e42a.jpg saved to cache
2026-03-27 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8c2350>
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F71%252F9171069d7f7483d1d2c0969abe148e6a%252Fpa%252FEK85406_149009a00fd5d900dcb291fbb75478da.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_149009a00fd5d900dcb291fbb75478da.jpg saved to cache
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40365f6a-9594-580b-8100-df4e29dc5945
2026-03-27 19:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40365f6a-9594-580b-8100-df4e29dc5945, skipping ID generation
2026-03-27 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40365f6a-9594-580b-8100-df4e29dc5945 with scrape type 1
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40365f6a-9594-580b-8100-df4e29dc5945 sending to next pipeline
2026-03-27 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40365f6a-9594-580b-8100-df4e29dc5945, identifier: EK85406
2026-03-27 19:00:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff5e850>
2026-03-27 19:00:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fbb%252Fd9bb2431e84f2d07e0a7a832a52f04f0%252Fpa%252FVF61988_7fdea6eb3689efb260456bdce28bd558.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7fdea6eb3689efb260456bdce28bd558.jpg saved to cache
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d9cc7d2-3682-536e-a507-90192b8e10ac
2026-03-27 19:00:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d9cc7d2-3682-536e-a507-90192b8e10ac, skipping ID generation
2026-03-27 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d9cc7d2-3682-536e-a507-90192b8e10ac with scrape type 1
2026-03-27 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d9cc7d2-3682-536e-a507-90192b8e10ac sending to next pipeline
2026-03-27 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d9cc7d2-3682-536e-a507-90192b8e10ac, identifier: VF61988
2026-03-27 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-27 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406
2026-03-27 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40365f6a-9594-580b-8100-df4e29dc5945 with identifier: EK85406 to the API
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_149009a00fd5d900dcb291fbb75478da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:47:52Z',
 'fuel_type': 'petrol',
 'id': '40365f6a-9594-580b-8100-df4e29dc5945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '30JDS8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK85406',
 'listing': 'auction',
 'location': 'NL, Heerlen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 116513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_3f4644c13bcd0539e2904b1eda69ddc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_41bb934351eb2636b95fef88f8cab50d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2477347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_c495c5bc9527b5bbfb8dbda7ea40179c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_09e351b345efed6e5bc2625c628315f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2494404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_149009a00fd5d900dcb291fbb75478da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_6095f39a179f65d50b9e12e928b60e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00942149d47869160de3fc7f10be9250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_1dcfdd316076896f3015a857be7aed3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_00d1a4083b2c6d0ea7eac9c6fe6606dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40365f6a-9594-580b-8100-df4e29dc5945/40365f6a-9594-580b-8100-df4e29dc5945_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/71/9171069d7f7483d1d2c0969abe148e6a/pa/EK85406_e9c52f93fe2489d7eacf8e967dc222bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-27 19:00:54 [auto1.nl] INFO: Saving data for EK85406: {'created_time': 1774638054.693519, 'last_price_update_time': 1774638054.693529, 'auction_closing_time': 1774716472.0}
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK85406') HTTP/1.1" 204 0
2026-03-27 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-27 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988
2026-03-27 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d9cc7d2-3682-536e-a507-90192b8e10ac with identifier: VF61988 to the API
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7fdea6eb3689efb260456bdce28bd558.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:04Z',
 'fuel_type': 'petrol',
 'id': '5d9cc7d2-3682-536e-a507-90192b8e10ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PS763P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF61988',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_1ca3ddb66e228426eda40f4d6be19041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2307261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7ccc54055a22968a35a518a98387e42a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_28955006536517eac68f31c50745a26e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_b342be52aa23bda0c88665742345dc35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_234c8b8e207bcb1c139040e925414913.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_370dc4aadba712e9b523f9a6deeffa10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_687db7865cf983fbd581efcd50091e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_5a83293aa10fb25117d011b79a2717fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_e15b4b3c6cfda4c228b5d30da9e8a688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d9cc7d2-3682-536e-a507-90192b8e10ac/5d9cc7d2-3682-536e-a507-90192b8e10ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/bb/d9bb2431e84f2d07e0a7a832a52f04f0/pa/VF61988_7fdea6eb3689efb260456bdce28bd558.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [auto1.nl] INFO: Saving data for VF61988: {'created_time': 1774638055.051887, 'last_price_update_time': 1774638055.0519, 'auction_closing_time': 1774716784.0}
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF61988') HTTP/1.1" 204 0
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM76247> (referer: https://www.auto1.com/v1/car-details-view/ZM76247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-27 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 1
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_eafbfda59020d7a778b4d5920b29cda3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_eafbfda59020d7a778b4d5920b29cda3.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_72da6ccdce61d711b9c777d73d1f9305.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_72da6ccdce61d711b9c777d73d1f9305.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_3e3de19f708404569a69c488f49d5aab.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_3e3de19f708404569a69c488f49d5aab.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_4bdec2980dde2a8f7b6549707f181907.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_4bdec2980dde2a8f7b6549707f181907.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg not downloaded yet
2026-03-27 19:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49638166-b992-5071-907d-8033173b68f8 with identifier: ZM76247
2026-03-27 19:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49638166-b992-5071-907d-8033173b68f8 with scrape type 1
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_e16c9bdb1c299934067868446c44aedc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_e16c9bdb1c299934067868446c44aedc.jpg not downloaded yet
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_eafbfda59020d7a778b4d5920b29cda3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg not downloaded yet
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_3e3de19f708404569a69c488f49d5aab.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_0294f97fe182ea9e0811fea891a03c00.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_0294f97fe182ea9e0811fea891a03c00.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_224d00548a7be74bb720aebfc83bdabb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_224d00548a7be74bb720aebfc83bdabb.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_422ae602d000ed174ab2bcb9925a7360.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_422ae602d000ed174ab2bcb9925a7360.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_95e444a4859a0540b05594bef0d7787c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_95e444a4859a0540b05594bef0d7787c.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_517af5d033e2dbe36434cdddb8150f31.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_517af5d033e2dbe36434cdddb8150f31.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_b68fa3e58159ea74a475a44349a318a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_b68fa3e58159ea74a475a44349a318a5.jpg not downloaded yet
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd5b6d0>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca1c1d0>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_eafbfda59020d7a778b4d5920b29cda3.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_eafbfda59020d7a778b4d5920b29cda3.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_72da6ccdce61d711b9c777d73d1f9305.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_224d00548a7be74bb720aebfc83bdabb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_01f6762c055a06e180bea2ad070db0fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_01f6762c055a06e180bea2ad070db0fb.jpg not downloaded yet
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c954590>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_3e3de19f708404569a69c488f49d5aab.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_3e3de19f708404569a69c488f49d5aab.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg not downloaded yet
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg not downloaded yet
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg not downloaded yet
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_517af5d033e2dbe36434cdddb8150f31.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_422ae602d000ed174ab2bcb9925a7360.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_0294f97fe182ea9e0811fea891a03c00.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg not downloaded yet
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca5a910>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_72da6ccdce61d711b9c777d73d1f9305.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_72da6ccdce61d711b9c777d73d1f9305.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffc8dd0>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_224d00548a7be74bb720aebfc83bdabb.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_224d00548a7be74bb720aebfc83bdabb.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffc76d0>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdc5610>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_517af5d033e2dbe36434cdddb8150f31.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_517af5d033e2dbe36434cdddb8150f31.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff67e90>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_422ae602d000ed174ab2bcb9925a7360.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_422ae602d000ed174ab2bcb9925a7360.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd4aa90>
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_0294f97fe182ea9e0811fea891a03c00.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_0294f97fe182ea9e0811fea891a03c00.jpg saved to cache
2026-03-27 19:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_95e444a4859a0540b05594bef0d7787c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL90951> (referer: https://www.auto1.com/v1/car-details-view/LL90951/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX76832/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_b68fa3e58159ea74a475a44349a318a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_4bdec2980dde2a8f7b6549707f181907.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_e16c9bdb1c299934067868446c44aedc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_01f6762c055a06e180bea2ad070db0fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca37f10>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_95e444a4859a0540b05594bef0d7787c.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_95e444a4859a0540b05594bef0d7787c.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-27 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66435a6-23a3-577c-9ed9-8183636e6060 with scrape type 1
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg not downloaded yet
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd3cfd0>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_b68fa3e58159ea74a475a44349a318a5.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_b68fa3e58159ea74a475a44349a318a5.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb81910>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca447d0>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_4bdec2980dde2a8f7b6549707f181907.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_4bdec2980dde2a8f7b6549707f181907.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c93b8d0>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd3de10>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Ffd%252F8cfd9fd27e915d4728d1b59ac5ce3208%252Fpa%252FKV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e
2026-03-27 19:00:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e, skipping ID generation
2026-03-27 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with scrape type 1
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07252a0b-a4b2-5178-94a4-3e50bf65bc9e sending to next pipeline
2026-03-27 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e, identifier: KV59291
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 19:00:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff86b10>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_e16c9bdb1c299934067868446c44aedc.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_e16c9bdb1c299934067868446c44aedc.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca85850>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_01f6762c055a06e180bea2ad070db0fb.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_01f6762c055a06e180bea2ad070db0fb.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb36990>
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg saved to cache
2026-03-27 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-27 19:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291
2026-03-27 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07252a0b-a4b2-5178-94a4-3e50bf65bc9e with identifier: KV59291 to the API
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:07:52Z',
 'fuel_type': 'hybrid',
 'id': '07252a0b-a4b2-5178-94a4-3e50bf65bc9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GZ965G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV59291',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 296665,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ca2a4cefed176b5c1a0e20c9f434c4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_eafbfda59020d7a778b4d5920b29cda3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_72da6ccdce61d711b9c777d73d1f9305.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_3e3de19f708404569a69c488f49d5aab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2446487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_4bdec2980dde2a8f7b6549707f181907.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2470821,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_f65a23c4f23fd25c12d3dec76172bc34.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2225339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_1629f7fcbe8ab39197b5eecb59edf185.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_224d00548a7be74bb720aebfc83bdabb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_ceb3eb8fd49d11552e34b3f4ce4a374c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07252a0b-a4b2-5178-94a4-3e50bf65bc9e/07252a0b-a4b2-5178-94a4-3e50bf65bc9e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/fd/8cfd9fd27e915d4728d1b59ac5ce3208/pa/KV59291_517af5d033e2dbe36434cdddb8150f31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.4 D5 Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2015}
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [auto1.nl] INFO: Saving data for KV59291: {'created_time': 1774638057.311481, 'last_price_update_time': 1774638057.311492, 'auction_closing_time': 1774714072.0}
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV59291') HTTP/1.1" 204 0
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg not downloaded yet
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c969890>
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg saved to cache
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb7d5d0>
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F03%252Fbd03aa785a3f42791b3197a3fa96d3ee%252Fpa%252FZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg saved to cache
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49638166-b992-5071-907d-8033173b68f8
2026-03-27 19:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49638166-b992-5071-907d-8033173b68f8, skipping ID generation
2026-03-27 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49638166-b992-5071-907d-8033173b68f8 with scrape type 1
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49638166-b992-5071-907d-8033173b68f8 sending to next pipeline
2026-03-27 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49638166-b992-5071-907d-8033173b68f8, identifier: ZM76247
2026-03-27 19:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49638166-b992-5071-907d-8033173b68f8 with identifier: ZM76247
2026-03-27 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49638166-b992-5071-907d-8033173b68f8 with identifier: ZM76247
2026-03-27 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49638166-b992-5071-907d-8033173b68f8 with identifier: ZM76247 to the API
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:11Z',
 'fuel_type': 'petrol',
 'id': '49638166-b992-5071-907d-8033173b68f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM76247',
 'listing': 'auction',
 'location': 'NL',
 'make': 'BMW',
 'model': '3er',
 'odometer': 266746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 24,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3912556,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_e16c9bdb1c299934067868446c44aedc.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_0294f97fe182ea9e0811fea891a03c00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_422ae602d000ed174ab2bcb9925a7360.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_95e444a4859a0540b05594bef0d7787c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_b68fa3e58159ea74a475a44349a318a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_01f6762c055a06e180bea2ad070db0fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_ce2d982c1fb62f3a95ed0d567e3ba61e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9a8f64dc7738c21a7e01493fd74162a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_fdcb59baeb8363b2ae0ec36a7161cf7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49638166-b992-5071-907d-8033173b68f8/49638166-b992-5071-907d-8033173b68f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/03/bd03aa785a3f42791b3197a3fa96d3ee/pa/ZM76247_9ff395c2843bb3849873b5ae1e2537c5.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM76247%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [auto1.nl] INFO: Saving data for ZM76247: {'created_time': 1774638057.879261, 'last_price_update_time': 1774638057.879273, 'auction_closing_time': 1774716971.0}
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZM76247') HTTP/1.1" 204 0
2026-03-27 19:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_fd197345e77e6b466ad7df488ce806e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_fd197345e77e6b466ad7df488ce806e5.jpg not downloaded yet
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg not downloaded yet
2026-03-27 19:00:57 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 916 | hits on page: 40
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg not downloaded yet
2026-03-27 19:00:57 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-27 19:00:57 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-27 19:00:57 [auto1.nl] INFO: Scrape type for CT33504: 2
2026-03-27 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with identifier: CT33504
2026-03-27 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with scrape type 2
2026-03-27 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with scrape type 2
2026-03-27 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3, identifier: CT33504
2026-03-27 19:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_28d2b496e1b1efa69c2986e44da5976d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_28d2b496e1b1efa69c2986e44da5976d.jpg not downloaded yet
2026-03-27 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with identifier: CT33504
2026-03-27 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with identifier: CT33504
2026-03-27 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 70896a8c-db8b-5482-ad0c-d80fb0a8b7e3 with identifier: CT33504 to the API
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:33Z',
 'fuel_type': 'diesel',
 'id': '70896a8c-db8b-5482-ad0c-d80fb0a8b7e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT33504',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 149926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [auto1.nl] INFO: Saving data for CT33504: {'auction_closing_time': 1774716333.0, 'created_time': 1774440092.787018, 'last_price_update_time': 1774638058.412345}
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT33504') HTTP/1.1" 204 0
2026-03-27 19:00:58 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-27 19:00:58 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [auto1.nl] INFO: Scrape type for MP54654: 2
2026-03-27 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-27 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a063b15f-6721-52ae-adc3-10c03f6e7901 with scrape type 2
2026-03-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a063b15f-6721-52ae-adc3-10c03f6e7901 with scrape type 2
2026-03-27 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a063b15f-6721-52ae-adc3-10c03f6e7901, identifier: MP54654
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg not downloaded yet
2026-03-27 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-27 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654
2026-03-27 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a063b15f-6721-52ae-adc3-10c03f6e7901 with identifier: MP54654 to the API
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:49Z',
 'fuel_type': 'diesel',
 'id': 'a063b15f-6721-52ae-adc3-10c03f6e7901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP54654',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 147695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [auto1.nl] INFO: Saving data for MP54654: {'auction_closing_time': 1774716829.0, 'created_time': 1773923498.998397, 'last_price_update_time': 1774638058.814}
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP54654') HTTP/1.1" 204 0
2026-03-27 19:00:58 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-27 19:00:58 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [auto1.nl] INFO: Scrape type for JK36770: 2
2026-03-27 19:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-27 19:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 500b09a5-838c-5a73-8fa1-e91fb40402f1 with scrape type 2
2026-03-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 500b09a5-838c-5a73-8fa1-e91fb40402f1 with scrape type 2
2026-03-27 19:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 500b09a5-838c-5a73-8fa1-e91fb40402f1, identifier: JK36770
2026-03-27 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_cac523b91d6253de19bd0f9982c35ade.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_cac523b91d6253de19bd0f9982c35ade.jpg not downloaded yet
2026-03-27 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-27 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770
2026-03-27 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 500b09a5-838c-5a73-8fa1-e91fb40402f1 with identifier: JK36770 to the API
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:50:26Z',
 'fuel_type': 'petrol',
 'id': '500b09a5-838c-5a73-8fa1-e91fb40402f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK36770',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 242967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-03',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-27 19:00:59 [auto1.nl] INFO: Saving data for JK36770: {'auction_closing_time': 1774716626.0, 'created_time': 1774551632.388114, 'last_price_update_time': 1774638059.228342}
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK36770') HTTP/1.1" 204 0
2026-03-27 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_fd197345e77e6b466ad7df488ce806e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-27 19:00:59 [auto1.nl] INFO: Scrape type for PG05474: 2
2026-03-27 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7385805d-aa7e-5c96-bbe4-85350390174d with identifier: PG05474
2026-03-27 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7385805d-aa7e-5c96-bbe4-85350390174d with scrape type 2
2026-03-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7385805d-aa7e-5c96-bbe4-85350390174d with scrape type 2
2026-03-27 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7385805d-aa7e-5c96-bbe4-85350390174d, identifier: PG05474
2026-03-27 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_28d2b496e1b1efa69c2986e44da5976d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg not downloaded yet
2026-03-27 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7385805d-aa7e-5c96-bbe4-85350390174d with identifier: PG05474
2026-03-27 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7385805d-aa7e-5c96-bbe4-85350390174d with identifier: PG05474
2026-03-27 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7385805d-aa7e-5c96-bbe4-85350390174d with identifier: PG05474 to the API
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:35Z',
 'fuel_type': 'petrol',
 'id': '7385805d-aa7e-5c96-bbe4-85350390174d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG05474',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 129627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2009}
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-27 19:00:59 [auto1.nl] INFO: Saving data for PG05474: {'auction_closing_time': 1774714595.0, 'created_time': 1774440053.999569, 'last_price_update_time': 1774638059.721671}
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PG05474') HTTP/1.1" 204 0
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-27 19:00:59 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-27 19:00:59 [auto1.nl] INFO: Scrape type for ZY63395: 2
2026-03-27 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-27 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e399b4a-c341-597c-ac0d-544407c5961d with scrape type 2
2026-03-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e399b4a-c341-597c-ac0d-544407c5961d with scrape type 2
2026-03-27 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e399b4a-c341-597c-ac0d-544407c5961d, identifier: ZY63395
2026-03-27 19:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cc190>
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg') HTTP/1.1" 204 0
2026-03-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg saved to cache
2026-03-27 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:00:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb38690>
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg saved to cache
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_7936db423297848e8da40d1f847bf61c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_7936db423297848e8da40d1f847bf61c.jpg not downloaded yet
2026-03-27 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395
2026-03-27 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e399b4a-c341-597c-ac0d-544407c5961d with identifier: ZY63395 to the API
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:10Z',
 'fuel_type': 'diesel',
 'id': '1e399b4a-c341-597c-ac0d-544407c5961d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY63395',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 198675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-11',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-27 19:01:00 [auto1.nl] INFO: Saving data for ZY63395: {'auction_closing_time': 1774716970.0, 'created_time': 1773687702.194732, 'last_price_update_time': 1774638060.348491}
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZY63395') HTTP/1.1" 204 0
2026-03-27 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:00 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-27 19:01:00 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-27 19:01:00 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-27 19:01:00 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-27 19:01:00 [auto1.nl] INFO: Scrape type for VW91946: 2
2026-03-27 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-27 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c34f38d-62c3-5f02-a8b4-02aed503c9da with scrape type 2
2026-03-27 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c34f38d-62c3-5f02-a8b4-02aed503c9da, identifier: VW91946
2026-03-27 19:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca50390>
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_fd197345e77e6b466ad7df488ce806e5.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_fd197345e77e6b466ad7df488ce806e5.jpg saved to cache
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca78890>
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg saved to cache
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9f20ea50>
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg saved to cache
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9e939450>
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_28d2b496e1b1efa69c2986e44da5976d.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_28d2b496e1b1efa69c2986e44da5976d.jpg saved to cache
2026-03-27 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_cac523b91d6253de19bd0f9982c35ade.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946
2026-03-27 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c34f38d-62c3-5f02-a8b4-02aed503c9da with identifier: VW91946 to the API
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:36:02Z',
 'fuel_type': 'petrol',
 'id': '5c34f38d-62c3-5f02-a8b4-02aed503c9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW91946',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 48295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.4 TCe Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2011}
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Saving data for VW91946: {'auction_closing_time': 1774715762.0, 'created_time': 1773687674.659382, 'last_price_update_time': 1774638061.220763}
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW91946') HTTP/1.1" 204 0
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Scrape type for VV88142: 2
2026-03-27 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-27 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410344a6-2d6d-55f8-b230-0fc2a1103eee with scrape type 2
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 410344a6-2d6d-55f8-b230-0fc2a1103eee with scrape type 2
2026-03-27 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 410344a6-2d6d-55f8-b230-0fc2a1103eee, identifier: VV88142
2026-03-27 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142
2026-03-27 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 410344a6-2d6d-55f8-b230-0fc2a1103eee with identifier: VV88142 to the API
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'petrol',
 'id': '410344a6-2d6d-55f8-b230-0fc2a1103eee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV88142',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 163917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Saving data for VV88142: {'auction_closing_time': 1774714694.0, 'created_time': 1774551638.040584, 'last_price_update_time': 1774638061.711188}
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV88142') HTTP/1.1" 204 0
2026-03-27 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX76832> (referer: https://www.auto1.com/v1/car-details-view/JX76832/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff66f10>
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg saved to cache
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Scrape type for CN01691: 0
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Scrape type for HC20329: 0
2026-03-27 19:01:01 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-27 19:01:01 [auto1.nl] INFO: Scrape type for ZL96236: 2
2026-03-27 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with identifier: ZL96236
2026-03-27 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with scrape type 2
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with scrape type 2
2026-03-27 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0d7aea7b-2e10-59dc-ad94-3bf698bd8188, identifier: ZL96236
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb11910>
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_cac523b91d6253de19bd0f9982c35ade.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_cac523b91d6253de19bd0f9982c35ade.jpg saved to cache
2026-03-27 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with identifier: ZL96236
2026-03-27 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with identifier: ZL96236
2026-03-27 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0d7aea7b-2e10-59dc-ad94-3bf698bd8188 with identifier: ZL96236 to the API
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:32:52Z',
 'fuel_type': 'petrol',
 'id': '0d7aea7b-2e10-59dc-ad94-3bf698bd8188',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL96236',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-03',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-27 19:01:02 [auto1.nl] INFO: Saving data for ZL96236: {'auction_closing_time': 1774715572.0, 'created_time': 1773229235.744002, 'last_price_update_time': 1774638062.418513}
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL96236') HTTP/1.1" 204 0
2026-03-27 19:01:02 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-27 19:01:02 [auto1.nl] INFO: Scrape type for JX67409: 2
2026-03-27 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with identifier: JX67409
2026-03-27 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with scrape type 2
2026-03-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with scrape type 2
2026-03-27 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f5f1d930-8b98-5dfb-bbc7-4af5c44189cf, identifier: JX67409
2026-03-27 19:01:02 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with identifier: JX67409
2026-03-27 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with identifier: JX67409
2026-03-27 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f5f1d930-8b98-5dfb-bbc7-4af5c44189cf with identifier: JX67409 to the API
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:46Z',
 'fuel_type': 'diesel',
 'id': 'f5f1d930-8b98-5dfb-bbc7-4af5c44189cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX67409',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 169673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-26',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2013}
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-27 19:01:02 [auto1.nl] INFO: Saving data for JX67409: {'auction_closing_time': 1774714306.0, 'created_time': 1773131911.757089, 'last_price_update_time': 1774638062.861917}
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX67409') HTTP/1.1" 204 0
2026-03-27 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:02 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-27 19:01:02 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-27 19:01:02 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-27 19:01:02 [auto1.nl] INFO: Scrape type for BF79856: 2
2026-03-27 19:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61851785-0882-5e4e-9f0c-cb2230e2cb7b with identifier: BF79856
2026-03-27 19:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61851785-0882-5e4e-9f0c-cb2230e2cb7b with scrape type 2
2026-03-27 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61851785-0882-5e4e-9f0c-cb2230e2cb7b with scrape type 2
2026-03-27 19:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 61851785-0882-5e4e-9f0c-cb2230e2cb7b, identifier: BF79856
2026-03-27 19:01:02 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-27 19:01:02 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [auto1.nl] INFO: Scrape type for LA33547: 2
2026-03-27 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-27 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0056fd52-e843-5584-bf42-6c43c5b312ab with scrape type 2
2026-03-27 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0056fd52-e843-5584-bf42-6c43c5b312ab, identifier: LA33547
2026-03-27 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_7936db423297848e8da40d1f847bf61c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 61851785-0882-5e4e-9f0c-cb2230e2cb7b with identifier: BF79856
2026-03-27 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 61851785-0882-5e4e-9f0c-cb2230e2cb7b with identifier: BF79856
2026-03-27 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 61851785-0882-5e4e-9f0c-cb2230e2cb7b with identifier: BF79856 to the API
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': '61851785-0882-5e4e-9f0c-cb2230e2cb7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF79856',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 43924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [auto1.nl] INFO: Saving data for BF79856: {'auction_closing_time': 1774715238.0, 'created_time': 1774440065.591037, 'last_price_update_time': 1774638063.350402}
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BF79856') HTTP/1.1" 204 0
2026-03-27 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-27 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547
2026-03-27 19:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0056fd52-e843-5584-bf42-6c43c5b312ab with identifier: LA33547 to the API
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'petrol',
 'id': '0056fd52-e843-5584-bf42-6c43c5b312ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA33547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 252394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [auto1.nl] INFO: Saving data for LA33547: {'auction_closing_time': 1774713662.0, 'created_time': 1774551627.625031, 'last_price_update_time': 1774638063.728533}
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA33547') HTTP/1.1" 204 0
2026-03-27 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-27 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4698296e-4baf-5297-8d4d-d578ff5edd95 with scrape type 1
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4698296e-4baf-5297-8d4d-d578ff5edd95
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_aeec283de234b2e80ce4ee56ed969027.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_aeec283de234b2e80ce4ee56ed969027.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_d370d7f5e914ff257e9a852dc761d887.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_d370d7f5e914ff257e9a852dc761d887.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_89f85f03151c8f98a932662e98296fd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_89f85f03151c8f98a932662e98296fd5.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_34eabb366f949283e263f9a912bd7da6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_34eabb366f949283e263f9a912bd7da6.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_f74793fda2fe787aa0b721551fd5f40a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_f74793fda2fe787aa0b721551fd5f40a.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_3ae2cbb3f66e735672f0c458900b2454.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_3ae2cbb3f66e735672f0c458900b2454.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_dbf531d61e9221b05aeb7ba9359d4b01.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_dbf531d61e9221b05aeb7ba9359d4b01.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_0e7e166008f6da0931ab3fc0987b821e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_0e7e166008f6da0931ab3fc0987b821e.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_97efdb5d6b21c18040856f53f80ca26d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_97efdb5d6b21c18040856f53f80ca26d.jpg already downloaded
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F81%252F2581ef260e76697d68d070b8acfe47e2%252Fpa%252FJX76832_fbc9e8b6c4b3fdfef20b1baae5319196.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_fbc9e8b6c4b3fdfef20b1baae5319196.jpg already downloaded
2026-03-27 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4698296e-4baf-5297-8d4d-d578ff5edd95, identifier: JX76832
2026-03-27 19:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for WP19214: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for KN68466: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for DW65450: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for XS82099: 0
2026-03-27 19:01:04 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Scrape type for BF50619: 2
2026-03-27 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-27 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879190fb-07e0-5193-a255-659073128779 with scrape type 2
2026-03-27 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879190fb-07e0-5193-a255-659073128779 with scrape type 2
2026-03-27 19:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 879190fb-07e0-5193-a255-659073128779, identifier: BF50619
2026-03-27 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-27 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832
2026-03-27 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4698296e-4baf-5297-8d4d-d578ff5edd95 with identifier: JX76832 to the API
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JX76832>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:09Z',
 'fuel_type': 'petrol',
 'id': '4698296e-4baf-5297-8d4d-d578ff5edd95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H772PL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX76832',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 136053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_aeec283de234b2e80ce4ee56ed969027.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_d370d7f5e914ff257e9a852dc761d887.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_89f85f03151c8f98a932662e98296fd5.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_34eabb366f949283e263f9a912bd7da6.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_f74793fda2fe787aa0b721551fd5f40a.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_3ae2cbb3f66e735672f0c458900b2454.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_dbf531d61e9221b05aeb7ba9359d4b01.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_0e7e166008f6da0931ab3fc0987b821e.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_97efdb5d6b21c18040856f53f80ca26d.jpg',
                'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_fbc9e8b6c4b3fdfef20b1baae5319196.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_aeec283de234b2e80ce4ee56ed969027.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_d370d7f5e914ff257e9a852dc761d887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_89f85f03151c8f98a932662e98296fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_34eabb366f949283e263f9a912bd7da6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_f74793fda2fe787aa0b721551fd5f40a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_3ae2cbb3f66e735672f0c458900b2454.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_dbf531d61e9221b05aeb7ba9359d4b01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_0e7e166008f6da0931ab3fc0987b821e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_97efdb5d6b21c18040856f53f80ca26d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4698296e-4baf-5297-8d4d-d578ff5edd95/4698296e-4baf-5297-8d4d-d578ff5edd95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/81/2581ef260e76697d68d070b8acfe47e2/pa/JX76832_fbc9e8b6c4b3fdfef20b1baae5319196.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2016}
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-27 19:01:04 [auto1.nl] INFO: Saving data for JX76832: {'created_time': 1774638064.61472, 'last_price_update_time': 1774638064.614734, 'auction_closing_time': 1774715229.0}
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX76832') HTTP/1.1" 204 0
2026-03-27 19:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-27 19:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619
2026-03-27 19:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 879190fb-07e0-5193-a255-659073128779 with identifier: BF50619 to the API
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:38:03Z',
 'fuel_type': 'diesel',
 'id': '879190fb-07e0-5193-a255-659073128779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF50619',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 301709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-06',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2016}
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Saving data for BF50619: {'auction_closing_time': 1774715883.0, 'created_time': 1773688416.211635, 'last_price_update_time': 1774638065.113088}
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BF50619') HTTP/1.1" 204 0
2026-03-27 19:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb4bf90>
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg saved to cache
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for GC72456: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for JK19053: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for HY67553: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for SA72680: 1
2026-03-27 19:01:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd68d10>
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F1e%252F301e4ccf08b14ba670d3dfe082a329dc%252Fpa%252FLL90951_7936db423297848e8da40d1f847bf61c.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_7936db423297848e8da40d1f847bf61c.jpg saved to cache
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d66435a6-23a3-577c-9ed9-8183636e6060
2026-03-27 19:01:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d66435a6-23a3-577c-9ed9-8183636e6060, skipping ID generation
2026-03-27 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66435a6-23a3-577c-9ed9-8183636e6060 with scrape type 1
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d66435a6-23a3-577c-9ed9-8183636e6060 sending to next pipeline
2026-03-27 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d66435a6-23a3-577c-9ed9-8183636e6060, identifier: LL90951
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for KM38195: 0
2026-03-27 19:01:05 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-27 19:01:05 [auto1.nl] INFO: Scrape type for YT29313: 2
2026-03-27 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with identifier: YT29313
2026-03-27 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with scrape type 2
2026-03-27 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with scrape type 2
2026-03-27 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f08de533-f4a0-5a62-aa99-0b2a0d6db4ed, identifier: YT29313
2026-03-27 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-27 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951
2026-03-27 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d66435a6-23a3-577c-9ed9-8183636e6060 with identifier: LL90951 to the API
2026-03-27 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_7936db423297848e8da40d1f847bf61c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 304,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.3L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'petrol',
 'id': 'd66435a6-23a3-577c-9ed9-8183636e6060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '78-XS-BL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL90951',
 'listing': 'auction',
 'location': 'NL, Almere',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 247575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 290257,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_29ca539c371e9c6873e2f4d488ab5ad8.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264539,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_8af02521a6a954cd6a66df4d5ea7479d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272523,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_fd197345e77e6b466ad7df488ce806e5.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258419,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_b3df4f3ec7d24a6c7b8ade3b1549d6ae.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35822,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_d1f1c58b066787ba0077fa0dfa803db1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43505,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_28d2b496e1b1efa69c2986e44da5976d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32637,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_4404a5c0f2b47aa4a450d0e7b20ea395.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36057,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_cac523b91d6253de19bd0f9982c35ade.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282159,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_ffd8fed1f806b2623590c9d14ba714fc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d66435a6-23a3-577c-9ed9-8183636e6060/d66435a6-23a3-577c-9ed9-8183636e6060_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286191,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img30/1e/301e4ccf08b14ba670d3dfe082a329dc/pa/LL90951_7936db423297848e8da40d1f847bf61c.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 V6 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2007}
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-27 19:01:06 [auto1.nl] INFO: Saving data for LL90951: {'created_time': 1774638066.668456, 'last_price_update_time': 1774638066.668468, 'auction_closing_time': 1774715577.0}
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LL90951') HTTP/1.1" 204 0
2026-03-27 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with identifier: YT29313
2026-03-27 19:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with identifier: YT29313
2026-03-27 19:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f08de533-f4a0-5a62-aa99-0b2a0d6db4ed with identifier: YT29313 to the API
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:04:44Z',
 'fuel_type': 'petrol',
 'id': 'f08de533-f4a0-5a62-aa99-0b2a0d6db4ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT29313',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 121699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'BMW 5er 520i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Saving data for YT29313: {'auction_closing_time': 1774713884.0, 'created_time': 1774440090.621702, 'last_price_update_time': 1774638067.041246}
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT29313') HTTP/1.1" 204 0
2026-03-27 19:01:07 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 37 pages/min), scraped 52 items (at 52 items/min)
2026-03-27 19:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Scrape type for LK58980: 1
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Scrape type for HX62268: 2
2026-03-27 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with identifier: HX62268
2026-03-27 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with scrape type 2
2026-03-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with scrape type 2
2026-03-27 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b217ab0d-290b-59ba-a0ec-5d0a090ff6e9, identifier: HX62268
2026-03-27 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with identifier: HX62268
2026-03-27 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with identifier: HX62268
2026-03-27 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b217ab0d-290b-59ba-a0ec-5d0a090ff6e9 with identifier: HX62268 to the API
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:10:25Z',
 'fuel_type': 'hybrid',
 'id': 'b217ab0d-290b-59ba-a0ec-5d0a090ff6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX62268',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 176158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-07',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Saving data for HX62268: {'auction_closing_time': 1774714225.0, 'created_time': 1774440083.23104, 'last_price_update_time': 1774638067.493333}
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HX62268') HTTP/1.1" 204 0
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Scrape type for BE76328: 0
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-27 19:01:07 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-27 19:01:07 [auto1.nl] INFO: Scrape type for BH50437: 2
2026-03-27 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-27 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc500800-7a85-5295-864a-159c54db01cd with scrape type 2
2026-03-27 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc500800-7a85-5295-864a-159c54db01cd with scrape type 2
2026-03-27 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc500800-7a85-5295-864a-159c54db01cd, identifier: BH50437
2026-03-27 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-27 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437
2026-03-27 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc500800-7a85-5295-864a-159c54db01cd with identifier: BH50437 to the API
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:05:27Z',
 'fuel_type': 'diesel',
 'id': 'fc500800-7a85-5295-864a-159c54db01cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH50437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 308741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-25',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.9 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2010}
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-27 19:01:08 [auto1.nl] INFO: Saving data for BH50437: {'auction_closing_time': 1774713927.0, 'created_time': 1774551631.673284, 'last_price_update_time': 1774638068.077703}
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH50437') HTTP/1.1" 204 0
2026-03-27 19:01:08 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-27 19:01:08 [auto1.nl] INFO: Scrape type for TG03602: 0
2026-03-27 19:01:08 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-27 19:01:08 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-27 19:01:08 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-27 19:01:08 [auto1.nl] INFO: Scrape type for PH10928: 2
2026-03-27 19:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29cca8ff-c794-5715-a001-0d34aa49daec with identifier: PH10928
2026-03-27 19:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29cca8ff-c794-5715-a001-0d34aa49daec with scrape type 2
2026-03-27 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29cca8ff-c794-5715-a001-0d34aa49daec with scrape type 2
2026-03-27 19:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 29cca8ff-c794-5715-a001-0d34aa49daec, identifier: PH10928
2026-03-27 19:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 29cca8ff-c794-5715-a001-0d34aa49daec with identifier: PH10928
2026-03-27 19:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 29cca8ff-c794-5715-a001-0d34aa49daec with identifier: PH10928
2026-03-27 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 29cca8ff-c794-5715-a001-0d34aa49daec with identifier: PH10928 to the API
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:35:34Z',
 'fuel_type': 'petrol',
 'id': '29cca8ff-c794-5715-a001-0d34aa49daec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH10928',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 135474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-09',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-27 19:01:09 [auto1.nl] INFO: Saving data for PH10928: {'auction_closing_time': 1774715734.0, 'created_time': 1774440029.77179, 'last_price_update_time': 1774638069.168791}
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PH10928') HTTP/1.1" 204 0
2026-03-27 19:01:09 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-27 19:01:09 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-27 19:01:09 [auto1.nl] INFO: Scrape type for CP13228: 0
2026-03-27 19:01:09 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-27 19:01:09 [auto1.nl] INFO: Scrape type for MW67597: 2
2026-03-27 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-27 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-27 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-27 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b21a97e-a144-5cdd-a610-f712529497ca, identifier: MW67597
2026-03-27 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-27 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-27 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597 to the API
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:56:30Z',
 'fuel_type': 'petrol',
 'id': '5b21a97e-a144-5cdd-a610-f712529497ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW67597',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 200763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 2.0 JTS Selesp Distinctive',
 'transmission': 'automatic',
 'trim': 'Selesp Distinctive',
 'year': 2005}
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-27 19:01:09 [auto1.nl] INFO: Saving data for MW67597: {'auction_closing_time': 1774716990.0, 'created_time': 1773947286.404418, 'last_price_update_time': 1774638069.678113}
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW67597') HTTP/1.1" 204 0
2026-03-27 19:01:09 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-27 19:01:09 [auto1.nl] INFO: Scrape type for DH15529: 2
2026-03-27 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-27 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c385d0a6-353e-546d-8744-31cdaa9fdb0b with scrape type 2
2026-03-27 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c385d0a6-353e-546d-8744-31cdaa9fdb0b with scrape type 2
2026-03-27 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c385d0a6-353e-546d-8744-31cdaa9fdb0b, identifier: DH15529
2026-03-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA72680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-27 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529
2026-03-27 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c385d0a6-353e-546d-8744-31cdaa9fdb0b with identifier: DH15529 to the API
2026-03-27 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'diesel',
 'id': 'c385d0a6-353e-546d-8744-31cdaa9fdb0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH15529',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 148686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-25',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Saving data for DH15529: {'auction_closing_time': 1774715987.0, 'created_time': 1774551644.516227, 'last_price_update_time': 1774638070.167644}
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DH15529') HTTP/1.1" 204 0
2026-03-27 19:01:10 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Scrape type for HH25512: 0
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Scrape type for LH67432: 2
2026-03-27 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-27 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35fad8bc-dde9-58df-8e1a-ab9135678d09 with scrape type 2
2026-03-27 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35fad8bc-dde9-58df-8e1a-ab9135678d09 with scrape type 2
2026-03-27 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35fad8bc-dde9-58df-8e1a-ab9135678d09, identifier: LH67432
2026-03-27 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-27 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432
2026-03-27 19:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35fad8bc-dde9-58df-8e1a-ab9135678d09 with identifier: LH67432 to the API
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:15:50Z',
 'fuel_type': 'petrol',
 'id': '35fad8bc-dde9-58df-8e1a-ab9135678d09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH67432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 150556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'BMW 3er 318i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Saving data for LH67432: {'auction_closing_time': 1774714550.0, 'created_time': 1773688356.552638, 'last_price_update_time': 1774638070.802108}
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH67432') HTTP/1.1" 204 0
2026-03-27 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Scrape type for TW17403: 0
2026-03-27 19:01:10 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-27 19:01:10 [auto1.nl] INFO: Scrape type for UT96124: 2
2026-03-27 19:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-27 19:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28511c30-641a-5e1a-a24e-6bf435694c18 with scrape type 2
2026-03-27 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28511c30-641a-5e1a-a24e-6bf435694c18 with scrape type 2
2026-03-27 19:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28511c30-641a-5e1a-a24e-6bf435694c18, identifier: UT96124
2026-03-27 19:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-27 19:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124
2026-03-27 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28511c30-641a-5e1a-a24e-6bf435694c18 with identifier: UT96124 to the API
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-28T16:00:08Z',
 'fuel_type': 'petrol',
 'id': '28511c30-641a-5e1a-a24e-6bf435694c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT96124',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 202533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2013}
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Saving data for UT96124: {'auction_closing_time': 1774713608.0, 'created_time': 1773924922.1521, 'last_price_update_time': 1774638071.251202}
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UT96124') HTTP/1.1" 204 0
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Scrape type for WG23592: 0
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-27 19:01:11 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Scrape type for SY25778: 2
2026-03-27 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with identifier: SY25778
2026-03-27 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with scrape type 2
2026-03-27 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with scrape type 2
2026-03-27 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dcf35a47-9073-5580-8f1a-c6aaf7ea4664, identifier: SY25778
2026-03-27 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK58980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with identifier: SY25778
2026-03-27 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with identifier: SY25778
2026-03-27 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dcf35a47-9073-5580-8f1a-c6aaf7ea4664 with identifier: SY25778 to the API
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:28Z',
 'fuel_type': 'petrol',
 'id': 'dcf35a47-9073-5580-8f1a-c6aaf7ea4664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY25778',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 108019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-27 19:01:11 [auto1.nl] INFO: Saving data for SY25778: {'auction_closing_time': 1774714168.0, 'created_time': 1774440109.399975, 'last_price_update_time': 1774638071.925128}
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY25778') HTTP/1.1" 204 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Scrape type for VC90690: 2
2026-03-27 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with identifier: VC90690
2026-03-27 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with scrape type 2
2026-03-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with scrape type 2
2026-03-27 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c, identifier: VC90690
2026-03-27 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with identifier: VC90690
2026-03-27 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with identifier: VC90690
2026-03-27 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c with identifier: VC90690 to the API
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:23:00Z',
 'fuel_type': 'hybrid',
 'id': '2e9d17a6-f78d-5ce1-b763-d2a1fe268e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC90690',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 215412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Saving data for VC90690: {'auction_closing_time': 1774714980.0, 'created_time': 1774440094.659792, 'last_price_update_time': 1774638072.446037}
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC90690') HTTP/1.1" 204 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Scrape type for TT16898: 2
2026-03-27 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with identifier: TT16898
2026-03-27 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with scrape type 2
2026-03-27 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with scrape type 2
2026-03-27 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb, identifier: TT16898
2026-03-27 19:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with identifier: TT16898
2026-03-27 19:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with identifier: TT16898
2026-03-27 19:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb with identifier: TT16898 to the API
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:58:03Z',
 'fuel_type': 'petrol',
 'id': '1cd0829b-1a30-5dd8-95eb-a362b4b3c7eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT16898',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 53247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2023}
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Saving data for TT16898: {'auction_closing_time': 1774717083.0, 'created_time': 1774033482.513498, 'last_price_update_time': 1774638072.868617}
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TT16898') HTTP/1.1" 204 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-27 19:01:12 [auto1.nl] INFO: Scrape type for KT83574: 0
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-27 19:01:12 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-27 19:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:13 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:13 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-27 19:01:13 [auto1.nl] INFO: Scrape type for BB94394: 2
2026-03-27 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-27 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93934ec-3fba-5968-8c52-ae1ceb8e0535 with scrape type 2
2026-03-27 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93934ec-3fba-5968-8c52-ae1ceb8e0535 with scrape type 2
2026-03-27 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d93934ec-3fba-5968-8c52-ae1ceb8e0535, identifier: BB94394
2026-03-27 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-27 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394
2026-03-27 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d93934ec-3fba-5968-8c52-ae1ceb8e0535 with identifier: BB94394 to the API
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:01:15Z',
 'fuel_type': 'petrol',
 'id': 'd93934ec-3fba-5968-8c52-ae1ceb8e0535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB94394',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 59468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-04',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2010}
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Saving data for BB94394: {'auction_closing_time': 1774713675.0, 'created_time': 1774551635.242074, 'last_price_update_time': 1774638074.364908}
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB94394') HTTP/1.1" 204 0
2026-03-27 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Scrape type for VG54194: 0
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Scrape type for TV23834: 0
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-27 19:01:14 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-27 19:01:14 [auto1.nl] INFO: Scrape type for EX49205: 2
2026-03-27 19:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 787746de-b02f-51ce-a8a4-f3c25aa93715 with identifier: EX49205
2026-03-27 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 787746de-b02f-51ce-a8a4-f3c25aa93715 with scrape type 2
2026-03-27 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 787746de-b02f-51ce-a8a4-f3c25aa93715 with scrape type 2
2026-03-27 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 787746de-b02f-51ce-a8a4-f3c25aa93715, identifier: EX49205
2026-03-27 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 787746de-b02f-51ce-a8a4-f3c25aa93715 with identifier: EX49205
2026-03-27 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 787746de-b02f-51ce-a8a4-f3c25aa93715 with identifier: EX49205
2026-03-27 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 787746de-b02f-51ce-a8a4-f3c25aa93715 with identifier: EX49205 to the API
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:52Z',
 'fuel_type': 'petrol',
 'id': '787746de-b02f-51ce-a8a4-f3c25aa93715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX49205',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 263695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-06',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Saving data for EX49205: {'auction_closing_time': 1774715752.0, 'created_time': 1774465249.56155, 'last_price_update_time': 1774638075.410807}
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX49205') HTTP/1.1" 204 0
2026-03-27 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA72680> (referer: https://www.auto1.com/v1/car-details-view/SA72680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:15 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Scrape type for YT16121: 2
2026-03-27 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-27 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7c034c-da13-542a-8807-7edd9ad404dc with scrape type 2
2026-03-27 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7c034c-da13-542a-8807-7edd9ad404dc with scrape type 2
2026-03-27 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc7c034c-da13-542a-8807-7edd9ad404dc, identifier: YT16121
2026-03-27 19:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK58980> (referer: https://www.auto1.com/v1/car-details-view/LK58980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-27 19:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121
2026-03-27 19:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc7c034c-da13-542a-8807-7edd9ad404dc with identifier: YT16121 to the API
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:07Z',
 'fuel_type': 'petrol',
 'id': 'dc7c034c-da13-542a-8807-7edd9ad404dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16121',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 253176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-20',
 'seller_name': None,
 'title': 'Citroen C4 2.0 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2005}
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Saving data for YT16121: {'auction_closing_time': 1774716607.0, 'created_time': 1773687811.416298, 'last_price_update_time': 1774638075.888833}
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT16121') HTTP/1.1" 204 0
2026-03-27 19:01:15 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Scrape type for AN01630: 0
2026-03-27 19:01:15 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-27 19:01:15 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-27 19:01:15 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-27 19:01:15 [auto1.nl] INFO: Scrape type for EH82816: 2
2026-03-27 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8356d561-8bac-5aff-8555-9e80b3d9113d with identifier: EH82816
2026-03-27 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8356d561-8bac-5aff-8555-9e80b3d9113d with scrape type 2
2026-03-27 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8356d561-8bac-5aff-8555-9e80b3d9113d with scrape type 2
2026-03-27 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8356d561-8bac-5aff-8555-9e80b3d9113d, identifier: EH82816
2026-03-27 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8356d561-8bac-5aff-8555-9e80b3d9113d with identifier: EH82816
2026-03-27 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8356d561-8bac-5aff-8555-9e80b3d9113d with identifier: EH82816
2026-03-27 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8356d561-8bac-5aff-8555-9e80b3d9113d with identifier: EH82816 to the API
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:32:45Z',
 'fuel_type': 'petrol',
 'id': '8356d561-8bac-5aff-8555-9e80b3d9113d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH82816',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 63529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-15',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Art Collection',
 'transmission': 'manual',
 'trim': 'Art Collection',
 'year': 2011}
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-27 19:01:16 [auto1.nl] INFO: Saving data for EH82816: {'auction_closing_time': 1774715565.0, 'created_time': 1774033362.149815, 'last_price_update_time': 1774638076.420481}
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EH82816') HTTP/1.1" 204 0
2026-03-27 19:01:16 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-27 19:01:16 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-27 19:01:16 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-27 19:01:16 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-27 19:01:16 [auto1.nl] INFO: Scrape type for UJ17437: 2
2026-03-27 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with identifier: UJ17437
2026-03-27 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with scrape type 2
2026-03-27 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with scrape type 2
2026-03-27 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed, identifier: UJ17437
2026-03-27 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with identifier: UJ17437
2026-03-27 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with identifier: UJ17437
2026-03-27 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9fe1ec87-eff0-58fa-b7a6-213bcfc77bed with identifier: UJ17437 to the API
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:01:51Z',
 'fuel_type': 'petrol',
 'id': '9fe1ec87-eff0-58fa-b7a6-213bcfc77bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ17437',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 85529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-03',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2013}
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-27 19:01:16 [auto1.nl] INFO: Saving data for UJ17437: {'auction_closing_time': 1774713711.0, 'created_time': 1774465254.94342, 'last_price_update_time': 1774638076.952153}
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UJ17437') HTTP/1.1" 204 0
2026-03-27 19:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-27 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with scrape type 1
2026-03-27 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_c8397eff1b9fc6be93f791b56f056390.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_c8397eff1b9fc6be93f791b56f056390.jpg not downloaded yet
2026-03-27 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-27 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bc705b-41f2-5916-9bc2-d306cbb5982c with scrape type 1
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg not downloaded yet
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [auto1.nl] INFO: Scrape type for PU28768: 2
2026-03-27 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e82278f-5836-51ad-9500-5296d0e0f2ff with identifier: PU28768
2026-03-27 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e82278f-5836-51ad-9500-5296d0e0f2ff with scrape type 2
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e82278f-5836-51ad-9500-5296d0e0f2ff with scrape type 2
2026-03-27 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e82278f-5836-51ad-9500-5296d0e0f2ff, identifier: PU28768
2026-03-27 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e82278f-5836-51ad-9500-5296d0e0f2ff with identifier: PU28768
2026-03-27 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e82278f-5836-51ad-9500-5296d0e0f2ff with identifier: PU28768
2026-03-27 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e82278f-5836-51ad-9500-5296d0e0f2ff with identifier: PU28768 to the API
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:59:19Z',
 'fuel_type': 'petrol',
 'id': '0e82278f-5836-51ad-9500-5296d0e0f2ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU28768',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 99448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-18',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Longitude FWD',
 'transmission': 'automatic',
 'trim': 'Longitude FWD',
 'year': 2017}
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [auto1.nl] INFO: Saving data for PU28768: {'auction_closing_time': 1774717159.0, 'created_time': 1773302035.805264, 'last_price_update_time': 1774638077.523288}
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PU28768') HTTP/1.1" 204 0
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_4f026cff0a873311c590a11d68824837.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_4f026cff0a873311c590a11d68824837.jpg not downloaded yet
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_233949bfc56571979876256d3aa27f43.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_233949bfc56571979876256d3aa27f43.jpg not downloaded yet
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-27 19:01:17 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [auto1.nl] INFO: Scrape type for MF68511: 2
2026-03-27 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-27 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74124519-82cc-5793-94d8-8bd98d784836 with scrape type 2
2026-03-27 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74124519-82cc-5793-94d8-8bd98d784836 with scrape type 2
2026-03-27 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74124519-82cc-5793-94d8-8bd98d784836, identifier: MF68511
2026-03-27 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-27 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511
2026-03-27 19:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74124519-82cc-5793-94d8-8bd98d784836 with identifier: MF68511 to the API
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:45Z',
 'fuel_type': 'diesel',
 'id': '74124519-82cc-5793-94d8-8bd98d784836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF68511',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 254893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-27 19:01:17 [auto1.nl] INFO: Saving data for MF68511: {'auction_closing_time': 1774715685.0, 'created_time': 1774551670.282208, 'last_price_update_time': 1774638077.977364}
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF68511') HTTP/1.1" 204 0
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_50c472fac4d2dac42629defb7da6ff24.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_50c472fac4d2dac42629defb7da6ff24.jpg not downloaded yet
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg not downloaded yet
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Scrape type for TG85730: 0
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Scrape type for GV74945: 0
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Scrape type for UC11957: 2
2026-03-27 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa621b43-6248-595f-bdfe-6169353b57ce with identifier: UC11957
2026-03-27 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa621b43-6248-595f-bdfe-6169353b57ce with scrape type 2
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa621b43-6248-595f-bdfe-6169353b57ce with scrape type 2
2026-03-27 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fa621b43-6248-595f-bdfe-6169353b57ce, identifier: UC11957
2026-03-27 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fa621b43-6248-595f-bdfe-6169353b57ce with identifier: UC11957
2026-03-27 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fa621b43-6248-595f-bdfe-6169353b57ce with identifier: UC11957
2026-03-27 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fa621b43-6248-595f-bdfe-6169353b57ce with identifier: UC11957 to the API
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:43:30Z',
 'fuel_type': 'petrol',
 'id': 'fa621b43-6248-595f-bdfe-6169353b57ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC11957',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 258306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-20',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Saving data for UC11957: {'auction_closing_time': 1774716210.0, 'created_time': 1774440044.777545, 'last_price_update_time': 1774638078.600491}
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC11957') HTTP/1.1" 204 0
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_065944603688278b1a8a93728a568584.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_065944603688278b1a8a93728a568584.jpg not downloaded yet
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_7ba0a299fc49af506191d2ded845fac1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_7ba0a299fc49af506191d2ded845fac1.jpg not downloaded yet
2026-03-27 19:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_c8397eff1b9fc6be93f791b56f056390.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:18 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-27 19:01:18 [auto1.nl] INFO: Scrape type for YF67230: 2
2026-03-27 19:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-27 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efefaf2c-d624-5bc1-b953-7e9dc937a9da with scrape type 2
2026-03-27 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efefaf2c-d624-5bc1-b953-7e9dc937a9da with scrape type 2
2026-03-27 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: efefaf2c-d624-5bc1-b953-7e9dc937a9da, identifier: YF67230
2026-03-27 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-27 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230
2026-03-27 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: efefaf2c-d624-5bc1-b953-7e9dc937a9da with identifier: YF67230 to the API
2026-03-27 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:43:04Z',
 'fuel_type': 'diesel',
 'id': 'efefaf2c-d624-5bc1-b953-7e9dc937a9da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF67230',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 225265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Saving data for YF67230: {'auction_closing_time': 1774716184.0, 'created_time': 1773229431.62868, 'last_price_update_time': 1774638079.11011}
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF67230') HTTP/1.1" 204 0
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_f1855b11add14dd85d8d721740fc8757.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_f1855b11add14dd85d8d721740fc8757.jpg not downloaded yet
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg not downloaded yet
2026-03-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_233949bfc56571979876256d3aa27f43.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Scrape type for WG43530: 0
2026-03-27 19:01:19 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb9b210>
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg saved to cache
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_4f026cff0a873311c590a11d68824837.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_a0040ed8894fd5027ce3b108604c110f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a0040ed8894fd5027ce3b108604c110f.jpg not downloaded yet
2026-03-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_50c472fac4d2dac42629defb7da6ff24.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Scrape type for UH74159: 2
2026-03-27 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with identifier: UH74159
2026-03-27 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with scrape type 2
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with scrape type 2
2026-03-27 19:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89, identifier: UH74159
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff87c10>
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_c8397eff1b9fc6be93f791b56f056390.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_c8397eff1b9fc6be93f791b56f056390.jpg saved to cache
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_5e11898238c9a126b0e0447e5f79b80b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_5e11898238c9a126b0e0447e5f79b80b.jpg not downloaded yet
2026-03-27 19:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with identifier: UH74159
2026-03-27 19:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with identifier: UH74159
2026-03-27 19:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89 with identifier: UH74159 to the API
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:28:04Z',
 'fuel_type': 'petrol',
 'id': '8b0a2a06-3bc7-56c4-9c82-ce2591a9bb89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH74159',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 76704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2018}
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Saving data for UH74159: {'auction_closing_time': 1774715284.0, 'created_time': 1774440106.087885, 'last_price_update_time': 1774638079.746617}
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UH74159') HTTP/1.1" 204 0
2026-03-27 19:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_7ba0a299fc49af506191d2ded845fac1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-27 19:01:19 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-27 19:01:19 [auto1.nl] INFO: Scrape type for DX60140: 2
2026-03-27 19:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-27 19:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad70305c-15ff-5e57-89a1-d6adb0704c86 with scrape type 2
2026-03-27 19:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad70305c-15ff-5e57-89a1-d6adb0704c86 with scrape type 2
2026-03-27 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad70305c-15ff-5e57-89a1-d6adb0704c86, identifier: DX60140
2026-03-27 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_065944603688278b1a8a93728a568584.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_04e71c65b259f3eacbc954c06ff08c97.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_04e71c65b259f3eacbc954c06ff08c97.jpg not downloaded yet
2026-03-27 19:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-27 19:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140
2026-03-27 19:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad70305c-15ff-5e57-89a1-d6adb0704c86 with identifier: DX60140 to the API
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:52Z',
 'fuel_type': 'petrol',
 'id': 'ad70305c-15ff-5e57-89a1-d6adb0704c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX60140',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 211897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-26',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Innovation Start&Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start&Stop',
 'year': 2017}
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Saving data for DX60140: {'auction_closing_time': 1774714432.0, 'created_time': 1773132078.272172, 'last_price_update_time': 1774638080.329655}
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX60140') HTTP/1.1" 204 0
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff22cd0>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_233949bfc56571979876256d3aa27f43.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_233949bfc56571979876256d3aa27f43.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff259d0>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca09dd0>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_4f026cff0a873311c590a11d68824837.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_4f026cff0a873311c590a11d68824837.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca6dd90>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_50c472fac4d2dac42629defb7da6ff24.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_50c472fac4d2dac42629defb7da6ff24.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_f1855b11add14dd85d8d721740fc8757.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for DY48945: 1
2026-03-27 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a0040ed8894fd5027ce3b108604c110f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_970697adb2dc3668b97b108d55af882a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_970697adb2dc3668b97b108d55af882a.jpg not downloaded yet
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM40908%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for GM40908: 1
2026-03-27 19:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff25550>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_7ba0a299fc49af506191d2ded845fac1.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_7ba0a299fc49af506191d2ded845fac1.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca50750>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca1f490>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_065944603688278b1a8a93728a568584.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_065944603688278b1a8a93728a568584.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_68781027a5caf03d367fe8dd77aa24f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_68781027a5caf03d367fe8dd77aa24f8.jpg not downloaded yet
2026-03-27 19:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_5e11898238c9a126b0e0447e5f79b80b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-27 19:01:20 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-27 19:01:20 [auto1.nl] INFO: Scrape type for PW38124: 2
2026-03-27 19:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-27 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with scrape type 2
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with scrape type 2
2026-03-27 19:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e, identifier: PW38124
2026-03-27 19:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff3d150>
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252Fc9%252F22c937583221bf8c5f7bd705e308c836%252Fpa%252FSA72680_f1855b11add14dd85d8d721740fc8757.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_f1855b11add14dd85d8d721740fc8757.jpg saved to cache
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9
2026-03-27 19:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9, skipping ID generation
2026-03-27 19:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with scrape type 1
2026-03-27 19:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 sending to next pipeline
2026-03-27 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9, identifier: SA72680
2026-03-27 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124
2026-03-27 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3239ea9a-d81e-5bd1-853e-5093b44d5e7e with identifier: PW38124 to the API
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:32:10Z',
 'fuel_type': 'petrol',
 'id': '3239ea9a-d81e-5bd1-853e-5093b44d5e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW38124',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 138914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Saving data for PW38124: {'auction_closing_time': 1774715530.0, 'created_time': 1774440075.113639, 'last_price_update_time': 1774638081.3329}
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PW38124') HTTP/1.1" 204 0
2026-03-27 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-27 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680
2026-03-27 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9 with identifier: SA72680 to the API
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_f1855b11add14dd85d8d721740fc8757.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:04Z',
 'fuel_type': 'petrol',
 'id': 'd9f35645-1fa8-580b-8c1b-d7d0b6ef23e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7TPD32',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA72680',
 'listing': 'auction',
 'location': 'NL, Tilburg',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 179677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_c8397eff1b9fc6be93f791b56f056390.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_4f026cff0a873311c590a11d68824837.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_50c472fac4d2dac42629defb7da6ff24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_065944603688278b1a8a93728a568584.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9/d9f35645-1fa8-580b-8c1b-d7d0b6ef23e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/c9/22c937583221bf8c5f7bd705e308c836/pa/SA72680_f1855b11add14dd85d8d721740fc8757.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto 0.9 My Punto',
 'transmission': 'manual',
 'trim': 'My',
 'year': 2014}
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Saving data for SA72680: {'created_time': 1774638081.74115, 'last_price_update_time': 1774638081.741162, 'auction_closing_time': 1774714984.0}
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA72680') HTTP/1.1" 204 0
2026-03-27 19:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca00a90>
2026-03-27 19:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_a0040ed8894fd5027ce3b108604c110f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a0040ed8894fd5027ce3b108604c110f.jpg saved to cache
2026-03-27 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_04e71c65b259f3eacbc954c06ff08c97.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for HS40359: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for RT82599: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for DB77408: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for JJ43979: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for LH74130: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-27 19:01:21 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: SP67754
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-27 19:01:21 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-27 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-27 19:01:22 [auto1.nl] INFO: Scrape type for KC58229: 0
2026-03-27 19:01:22 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-27 19:01:22 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-27 19:01:22 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-27 19:01:22 [auto1.nl] INFO: Scrape type for PC64486: 2
2026-03-27 19:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with scrape type 2
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with scrape type 2
2026-03-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf, identifier: PC64486
2026-03-27 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_970697adb2dc3668b97b108d55af882a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-27 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486
2026-03-27 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d4e9b9c-8e49-5e71-909c-3826625ec4cf with identifier: PC64486 to the API
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:00:50Z',
 'fuel_type': 'petrol',
 'id': '7d4e9b9c-8e49-5e71-909c-3826625ec4cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC64486',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 156774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Citroen C5 1.6 THP Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-27 19:01:22 [auto1.nl] INFO: Saving data for PC64486: {'auction_closing_time': 1774713650.0, 'created_time': 1773131926.568362, 'last_price_update_time': 1774638082.406014}
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PC64486') HTTP/1.1" 204 0
2026-03-27 19:01:22 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfa035e4d0>
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_5e11898238c9a126b0e0447e5f79b80b.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_5e11898238c9a126b0e0447e5f79b80b.jpg saved to cache
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_68781027a5caf03d367fe8dd77aa24f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9c7f90>
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_04e71c65b259f3eacbc954c06ff08c97.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_04e71c65b259f3eacbc954c06ff08c97.jpg saved to cache
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9b8110>
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_970697adb2dc3668b97b108d55af882a.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_970697adb2dc3668b97b108d55af882a.jpg saved to cache
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdaaa50>
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3a%252Fde3a297b14e82e78475689c0ac230557%252Fpa%252FLK58980_68781027a5caf03d367fe8dd77aa24f8.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_68781027a5caf03d367fe8dd77aa24f8.jpg saved to cache
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00bc705b-41f2-5916-9bc2-d306cbb5982c
2026-03-27 19:01:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00bc705b-41f2-5916-9bc2-d306cbb5982c, skipping ID generation
2026-03-27 19:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00bc705b-41f2-5916-9bc2-d306cbb5982c with scrape type 1
2026-03-27 19:01:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00bc705b-41f2-5916-9bc2-d306cbb5982c sending to next pipeline
2026-03-27 19:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 00bc705b-41f2-5916-9bc2-d306cbb5982c, identifier: LK58980
2026-03-27 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-27 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980
2026-03-27 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 00bc705b-41f2-5916-9bc2-d306cbb5982c with identifier: LK58980 to the API
2026-03-27 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_68781027a5caf03d367fe8dd77aa24f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 257,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:41:31Z',
 'fuel_type': 'diesel',
 'id': '00bc705b-41f2-5916-9bc2-d306cbb5982c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '3VHT12',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK58980',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 272664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_939aaf8dccb4bff1c8e8c60ccd334d9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_233949bfc56571979876256d3aa27f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_93565022e147a4cc0c61cfefe0b2ce8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_7ba0a299fc49af506191d2ded845fac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a1dc5404c3e1d8c546047bdd9256909f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_a0040ed8894fd5027ce3b108604c110f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50460,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_5e11898238c9a126b0e0447e5f79b80b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_04e71c65b259f3eacbc954c06ff08c97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_970697adb2dc3668b97b108d55af882a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00bc705b-41f2-5916-9bc2-d306cbb5982c/00bc705b-41f2-5916-9bc2-d306cbb5982c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3a/de3a297b14e82e78475689c0ac230557/pa/LK58980_68781027a5caf03d367fe8dd77aa24f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Saving data for LK58980: {'created_time': 1774638083.125487, 'last_price_update_time': 1774638083.125498, 'auction_closing_time': 1774716091.0}
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LK58980') HTTP/1.1" 204 0
2026-03-27 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY48945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:23 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Scrape type for TF74045: 0
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Scrape type for BW31181: 2
2026-03-27 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-27 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with scrape type 2
2026-03-27 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with scrape type 2
2026-03-27 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd, identifier: BW31181
2026-03-27 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-27 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181
2026-03-27 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd with identifier: BW31181 to the API
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:47:42Z',
 'fuel_type': 'petrol',
 'id': 'a0c7bc89-6e24-5c2e-8b18-2b05bbe4dfdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW31181',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 133379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Saving data for BW31181: {'auction_closing_time': 1774716462.0, 'created_time': 1773132071.053099, 'last_price_update_time': 1774638083.667021}
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW31181') HTTP/1.1" 204 0
2026-03-27 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Scrape type for SL71745: 0
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Scrape type for ZB66825: 0
2026-03-27 19:01:23 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-27 19:01:23 [auto1.nl] INFO: Scrape type for HU61188: 2
2026-03-27 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with identifier: HU61188
2026-03-27 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with scrape type 2
2026-03-27 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with scrape type 2
2026-03-27 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b3e0e24e-e1c1-555d-ae97-2fd48168ab3a, identifier: HU61188
2026-03-27 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with identifier: HU61188
2026-03-27 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with identifier: HU61188
2026-03-27 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b3e0e24e-e1c1-555d-ae97-2fd48168ab3a with identifier: HU61188 to the API
2026-03-27 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:49:14Z',
 'fuel_type': 'petrol',
 'id': 'b3e0e24e-e1c1-555d-ae97-2fd48168ab3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU61188',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 169668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-15',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Saving data for HU61188: {'auction_closing_time': 1774716554.0, 'created_time': 1773133991.057443, 'last_price_update_time': 1774638084.112768}
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HU61188') HTTP/1.1" 204 0
2026-03-27 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM40908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for AV65488: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for HZ82321: 1
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for EC34005: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for GD46513: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for PL46145: 0
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for YD79188: 2
2026-03-27 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-27 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18414057-f9ff-588c-941e-7fe97a82144f with scrape type 2
2026-03-27 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18414057-f9ff-588c-941e-7fe97a82144f with scrape type 2
2026-03-27 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 18414057-f9ff-588c-941e-7fe97a82144f, identifier: YD79188
2026-03-27 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-27 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188
2026-03-27 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 18414057-f9ff-588c-941e-7fe97a82144f with identifier: YD79188 to the API
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:39:12Z',
 'fuel_type': 'petrol',
 'id': '18414057-f9ff-588c-941e-7fe97a82144f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD79188',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 166849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-26',
 'seller_name': None,
 'title': 'Audi A5 Sportback 1.8 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Saving data for YD79188: {'auction_closing_time': 1774715952.0, 'created_time': 1773131879.283355, 'last_price_update_time': 1774638084.714287}
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YD79188') HTTP/1.1" 204 0
2026-03-27 19:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:24 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-27 19:01:24 [auto1.nl] INFO: Scrape type for FD12318: 2
2026-03-27 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-27 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7bf4782-045f-5465-8d63-b67681dd239a with scrape type 2
2026-03-27 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7bf4782-045f-5465-8d63-b67681dd239a with scrape type 2
2026-03-27 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7bf4782-045f-5465-8d63-b67681dd239a, identifier: FD12318
2026-03-27 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-27 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318
2026-03-27 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7bf4782-045f-5465-8d63-b67681dd239a with identifier: FD12318 to the API
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:46:18Z',
 'fuel_type': 'petrol',
 'id': 'a7bf4782-045f-5465-8d63-b67681dd239a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD12318',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Cuore',
 'odometer': 157553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-27',
 'seller_name': None,
 'title': 'Daihatsu Cuore 1.0 Chili',
 'transmission': 'manual',
 'trim': 'Chili',
 'year': 2006}
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Saving data for FD12318: {'auction_closing_time': 1774716378.0, 'created_time': 1774551640.971748, 'last_price_update_time': 1774638085.241627}
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD12318') HTTP/1.1" 204 0
2026-03-27 19:01:25 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Scrape type for EM66057: 1
2026-03-27 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:25 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Scrape type for JA24721: 0
2026-03-27 19:01:25 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Scrape type for LT65669: 2
2026-03-27 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-27 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b689a036-6f9c-571a-bd90-1094ac234281 with scrape type 2
2026-03-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b689a036-6f9c-571a-bd90-1094ac234281 with scrape type 2
2026-03-27 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b689a036-6f9c-571a-bd90-1094ac234281, identifier: LT65669
2026-03-27 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-27 19:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669
2026-03-27 19:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b689a036-6f9c-571a-bd90-1094ac234281 with identifier: LT65669 to the API
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:20Z',
 'fuel_type': 'petrol',
 'id': 'b689a036-6f9c-571a-bd90-1094ac234281',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT65669',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 212084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Saving data for LT65669: {'auction_closing_time': 1774714640.0, 'created_time': 1773131914.329328, 'last_price_update_time': 1774638085.678574}
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT65669') HTTP/1.1" 204 0
2026-03-27 19:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:25 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Scrape type for AL58798: 0
2026-03-27 19:01:25 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-27 19:01:25 [auto1.nl] INFO: Scrape type for RG26073: 2
2026-03-27 19:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-27 19:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with scrape type 2
2026-03-27 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with scrape type 2
2026-03-27 19:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc, identifier: RG26073
2026-03-27 19:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:01:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073
2026-03-27 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 767fec7e-b69c-5cf3-b20a-8d2b9ce871dc with identifier: RG26073 to the API
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:48:02Z',
 'fuel_type': 'electro',
 'id': '767fec7e-b69c-5cf3-b20a-8d2b9ce871dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG26073',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 159395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Saving data for RG26073: {'auction_closing_time': 1774716482.0, 'created_time': 1774440104.302326, 'last_price_update_time': 1774638086.338484}
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RG26073') HTTP/1.1" 204 0
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-27 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY48945> (referer: https://www.auto1.com/v1/car-details-view/DY48945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW75343> (referer: https://www.auto1.com/v1/car-details-view/CW75343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:26 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Scrape type for RW09535: 0
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-27 19:01:26 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Scrape type for ZN91004: 2
2026-03-27 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2aab466-f702-5c5e-a4d8-0df13559a1e4 with identifier: ZN91004
2026-03-27 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2aab466-f702-5c5e-a4d8-0df13559a1e4 with scrape type 2
2026-03-27 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2aab466-f702-5c5e-a4d8-0df13559a1e4 with scrape type 2
2026-03-27 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2aab466-f702-5c5e-a4d8-0df13559a1e4, identifier: ZN91004
2026-03-27 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2aab466-f702-5c5e-a4d8-0df13559a1e4 with identifier: ZN91004
2026-03-27 19:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2aab466-f702-5c5e-a4d8-0df13559a1e4 with identifier: ZN91004
2026-03-27 19:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2aab466-f702-5c5e-a4d8-0df13559a1e4 with identifier: ZN91004 to the API
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:25Z',
 'fuel_type': 'petrol',
 'id': 'f2aab466-f702-5c5e-a4d8-0df13559a1e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN91004',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 69138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-27 19:01:26 [auto1.nl] INFO: Saving data for ZN91004: {'auction_closing_time': 1774716325.0, 'created_time': 1773302189.5502, 'last_price_update_time': 1774638086.933632}
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN91004') HTTP/1.1" 204 0
2026-03-27 19:01:27 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [auto1.nl] INFO: Scrape type for XZ67857: 0
2026-03-27 19:01:27 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-27 19:01:27 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [auto1.nl] INFO: Scrape type for HB74565: 2
2026-03-27 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-27 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e68c6212-7dee-5853-aa86-6c0136a96ff6 with scrape type 2
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e68c6212-7dee-5853-aa86-6c0136a96ff6 with scrape type 2
2026-03-27 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e68c6212-7dee-5853-aa86-6c0136a96ff6, identifier: HB74565
2026-03-27 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-27 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932ce692-33f7-5822-8d2a-318f69891fe6 with scrape type 1
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 932ce692-33f7-5822-8d2a-318f69891fe6
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_a07c4b733eba869514b798ebae9dcc27.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_a07c4b733eba869514b798ebae9dcc27.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_119b24271f853921b7ac49a56a5a6c77.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_119b24271f853921b7ac49a56a5a6c77.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_ca5d9170f34d71f32dc14152c9703804.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_ca5d9170f34d71f32dc14152c9703804.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_9a4ebda68a8824db481117e16d7d73f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9a4ebda68a8824db481117e16d7d73f6.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_fc025772ddb1692630f856daaaa63ca3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_fc025772ddb1692630f856daaaa63ca3.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_3b483e8ef8cf9e61cd1889b3beaaf2f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_3b483e8ef8cf9e61cd1889b3beaaf2f8.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_f3209ef05db51e6597287b8d3c0e7346.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_f3209ef05db51e6597287b8d3c0e7346.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_352981cd5d346cb1032303d1755033f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_352981cd5d346cb1032303d1755033f3.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_e4d198053e5e648badb9677a9cb5f21c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_e4d198053e5e648badb9677a9cb5f21c.jpg already downloaded
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F30%252F5c30afea9e12e1022df13bdd2ebb1123%252Fpa%252FDY48945_9c574f2541fee35ab1ed8a33aaf03657.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9c574f2541fee35ab1ed8a33aaf03657.jpg already downloaded
2026-03-27 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 932ce692-33f7-5822-8d2a-318f69891fe6, identifier: DY48945
2026-03-27 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-27 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565
2026-03-27 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e68c6212-7dee-5853-aa86-6c0136a96ff6 with identifier: HB74565 to the API
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:19Z',
 'fuel_type': 'petrol',
 'id': 'e68c6212-7dee-5853-aa86-6c0136a96ff6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB74565',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 125391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-04',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-27 19:01:27 [auto1.nl] INFO: Saving data for HB74565: {'auction_closing_time': 1774716979.0, 'created_time': 1774551628.122595, 'last_price_update_time': 1774638087.720426}
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HB74565') HTTP/1.1" 204 0
2026-03-27 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-27 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945
2026-03-27 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 932ce692-33f7-5822-8d2a-318f69891fe6 with identifier: DY48945 to the API
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY48945>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:04Z',
 'fuel_type': 'diesel',
 'id': '932ce692-33f7-5822-8d2a-318f69891fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP138V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY48945',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 180748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_a07c4b733eba869514b798ebae9dcc27.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_119b24271f853921b7ac49a56a5a6c77.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_ca5d9170f34d71f32dc14152c9703804.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9a4ebda68a8824db481117e16d7d73f6.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_fc025772ddb1692630f856daaaa63ca3.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_3b483e8ef8cf9e61cd1889b3beaaf2f8.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_f3209ef05db51e6597287b8d3c0e7346.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_352981cd5d346cb1032303d1755033f3.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_e4d198053e5e648badb9677a9cb5f21c.jpg',
                'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9c574f2541fee35ab1ed8a33aaf03657.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_a07c4b733eba869514b798ebae9dcc27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_119b24271f853921b7ac49a56a5a6c77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_ca5d9170f34d71f32dc14152c9703804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9a4ebda68a8824db481117e16d7d73f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_fc025772ddb1692630f856daaaa63ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_3b483e8ef8cf9e61cd1889b3beaaf2f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_f3209ef05db51e6597287b8d3c0e7346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_352981cd5d346cb1032303d1755033f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_e4d198053e5e648badb9677a9cb5f21c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_932ce692-33f7-5822-8d2a-318f69891fe6/932ce692-33f7-5822-8d2a-318f69891fe6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/30/5c30afea9e12e1022df13bdd2ebb1123/pa/DY48945_9c574f2541fee35ab1ed8a33aaf03657.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2016}
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Saving data for DY48945: {'created_time': 1774638088.030508, 'last_price_update_time': 1774638088.030518, 'auction_closing_time': 1774716124.0}
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DY48945') HTTP/1.1" 204 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for TV26065: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for AX29422: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for WP75740: 2
2026-03-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1993dc-4522-5244-a2f5-7a4314a9b62b with scrape type 2
2026-03-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1993dc-4522-5244-a2f5-7a4314a9b62b with scrape type 2
2026-03-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1b1993dc-4522-5244-a2f5-7a4314a9b62b, identifier: WP75740
2026-03-27 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-27 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740
2026-03-27 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1b1993dc-4522-5244-a2f5-7a4314a9b62b with identifier: WP75740 to the API
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:05:09Z',
 'fuel_type': 'petrol',
 'id': '1b1993dc-4522-5244-a2f5-7a4314a9b62b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP75740',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 227439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-02',
 'seller_name': None,
 'title': 'Peugeot 407 3.0 V6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2005}
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Saving data for WP75740: {'auction_closing_time': 1774713909.0, 'created_time': 1774551671.066531, 'last_price_update_time': 1774638088.483295}
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP75740') HTTP/1.1" 204 0
2026-03-27 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ82321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM40908> (referer: https://www.auto1.com/v1/car-details-view/GM40908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acebb036-bb76-5dea-83bf-fbb110194bb1 with scrape type 1
2026-03-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_68a52d390d1e08182f944ce5cf7fc576.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_68a52d390d1e08182f944ce5cf7fc576.jpg not downloaded yet
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for ZK25360: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-27 19:01:28 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-27 19:01:28 [auto1.nl] INFO: Scrape type for LW98869: 2
2026-03-27 19:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-27 19:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e86e2b86-e406-5613-86d3-35a1265a36f2 with scrape type 2
2026-03-27 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e86e2b86-e406-5613-86d3-35a1265a36f2 with scrape type 2
2026-03-27 19:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e86e2b86-e406-5613-86d3-35a1265a36f2, identifier: LW98869
2026-03-27 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-27 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869
2026-03-27 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e86e2b86-e406-5613-86d3-35a1265a36f2 with identifier: LW98869 to the API
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'petrol',
 'id': 'e86e2b86-e406-5613-86d3-35a1265a36f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW98869',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 124381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-10',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [auto1.nl] INFO: Saving data for LW98869: {'auction_closing_time': 1774713977.0, 'created_time': 1773921666.53404, 'last_price_update_time': 1774638089.047754}
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW98869') HTTP/1.1" 204 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg not downloaded yet
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [auto1.nl] INFO: Scrape type for LA08041: 0
2026-03-27 19:01:29 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM66057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_2078dbed947285a8069dc97d48541563.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2078dbed947285a8069dc97d48541563.jpg not downloaded yet
2026-03-27 19:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7478899c-3b35-5443-9174-2cf2e2fe6689 with identifier: GM40908
2026-03-27 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7478899c-3b35-5443-9174-2cf2e2fe6689 with scrape type 1
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_208ca30517b43875b7833643778d7a85.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_208ca30517b43875b7833643778d7a85.jpg not downloaded yet
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg not downloaded yet
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_2c1cadb957c36383d131556f92e38ccb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_2c1cadb957c36383d131556f92e38ccb.jpg not downloaded yet
2026-03-27 19:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_68a52d390d1e08182f944ce5cf7fc576.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg not downloaded yet
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg not downloaded yet
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_b1edb35d380889a16813cd1932435758.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_b1edb35d380889a16813cd1932435758.jpg not downloaded yet
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_208ca30517b43875b7833643778d7a85.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_235aef4c76f43d9f05f1d6658390a414.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_235aef4c76f43d9f05f1d6658390a414.jpg not downloaded yet
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2078dbed947285a8069dc97d48541563.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg not downloaded yet
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_6013a761fd64d5733e1205f488b3afd5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_6013a761fd64d5733e1205f488b3afd5.jpg not downloaded yet
2026-03-27 19:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c910910>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_68a52d390d1e08182f944ce5cf7fc576.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_68a52d390d1e08182f944ce5cf7fc576.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_5bebe62a45d5f25dee347a908eecd95f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_5bebe62a45d5f25dee347a908eecd95f.jpg not downloaded yet
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg not downloaded yet
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca510d0>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_208ca30517b43875b7833643778d7a85.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_208ca30517b43875b7833643778d7a85.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_29c79d126224c3c301f24978664cd1ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_29c79d126224c3c301f24978664cd1ab.jpg not downloaded yet
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_2c1cadb957c36383d131556f92e38ccb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_6013a761fd64d5733e1205f488b3afd5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca52810>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdb6b50>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_2078dbed947285a8069dc97d48541563.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2078dbed947285a8069dc97d48541563.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg not downloaded yet
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_5bebe62a45d5f25dee347a908eecd95f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_235aef4c76f43d9f05f1d6658390a414.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_b1edb35d380889a16813cd1932435758.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg not downloaded yet
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca08f50>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff1b750>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_2c1cadb957c36383d131556f92e38ccb.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_2c1cadb957c36383d131556f92e38ccb.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c99c810>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_6013a761fd64d5733e1205f488b3afd5.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_6013a761fd64d5733e1205f488b3afd5.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_29c79d126224c3c301f24978664cd1ab.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca27610>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c97d150>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_5bebe62a45d5f25dee347a908eecd95f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_5bebe62a45d5f25dee347a908eecd95f.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb8cb90>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_235aef4c76f43d9f05f1d6658390a414.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_235aef4c76f43d9f05f1d6658390a414.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff28610>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c977cd0>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_b1edb35d380889a16813cd1932435758.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_b1edb35d380889a16813cd1932435758.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda5490>
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F8f%252F838f356183eb07cceda1d6990cf31c43%252Fpa%252FCW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg saved to cache
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acebb036-bb76-5dea-83bf-fbb110194bb1
2026-03-27 19:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acebb036-bb76-5dea-83bf-fbb110194bb1, skipping ID generation
2026-03-27 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acebb036-bb76-5dea-83bf-fbb110194bb1 with scrape type 1
2026-03-27 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acebb036-bb76-5dea-83bf-fbb110194bb1 sending to next pipeline
2026-03-27 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acebb036-bb76-5dea-83bf-fbb110194bb1, identifier: CW75343
2026-03-27 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca63910>
2026-03-27 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_29c79d126224c3c301f24978664cd1ab.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_29c79d126224c3c301f24978664cd1ab.jpg saved to cache
2026-03-27 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:30 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-27 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343
2026-03-27 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acebb036-bb76-5dea-83bf-fbb110194bb1 with identifier: CW75343 to the API
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:38:04Z',
 'fuel_type': 'electro',
 'id': 'acebb036-bb76-5dea-83bf-fbb110194bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'N854PG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW75343',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'BMW',
 'model': 'i4',
 'odometer': 194087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98297,
             'Height': 583,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_68a52d390d1e08182f944ce5cf7fc576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_48fc5e1cdf0745ccc6b9bdb0e729f4b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93072,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2078dbed947285a8069dc97d48541563.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_9cebabba8a02deac34f1a09bfff1a7ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_a1b39fb4316b74c28d5ed5dc223b4c45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_b1edb35d380889a16813cd1932435758.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acebb036-bb76-5dea-83bf-fbb110194bb1/acebb036-bb76-5dea-83bf-fbb110194bb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/8f/838f356183eb07cceda1d6990cf31c43/pa/CW75343_2d8d7d48dd7898b06f5d697088957d4a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW i4 eDrive40 Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-27 19:01:30 [auto1.nl] INFO: Saving data for CW75343: {'created_time': 1774638090.551284, 'last_price_update_time': 1774638090.551295, 'auction_closing_time': 1774715884.0}
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CW75343') HTTP/1.1" 204 0
2026-03-27 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:30 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-27 19:01:30 [auto1.nl] INFO: Scrape type for XY67301: 2
2026-03-27 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-27 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f74ec2-b968-5eb3-a74f-be295b6f0aef with scrape type 2
2026-03-27 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53f74ec2-b968-5eb3-a74f-be295b6f0aef with scrape type 2
2026-03-27 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 53f74ec2-b968-5eb3-a74f-be295b6f0aef, identifier: XY67301
2026-03-27 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-27 19:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301
2026-03-27 19:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 53f74ec2-b968-5eb3-a74f-be295b6f0aef with identifier: XY67301 to the API
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:22Z',
 'fuel_type': 'petrol',
 'id': '53f74ec2-b968-5eb3-a74f-be295b6f0aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY67301',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 83449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-05',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2017}
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Saving data for XY67301: {'auction_closing_time': 1774716322.0, 'created_time': 1773134418.696533, 'last_price_update_time': 1774638091.07261}
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY67301') HTTP/1.1" 204 0
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV84251%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Scrape type for WV84251: 1
2026-03-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ82321> (referer: https://www.auto1.com/v1/car-details-view/HZ82321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM66057> (referer: https://www.auto1.com/v1/car-details-view/EM66057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c90c710>
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg saved to cache
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca46f10>
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg saved to cache
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Scrape type for AY73779: 2
2026-03-27 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52d402e-f8fc-5235-a8e4-e43ba829d0ba with identifier: AY73779
2026-03-27 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52d402e-f8fc-5235-a8e4-e43ba829d0ba with scrape type 2
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c52d402e-f8fc-5235-a8e4-e43ba829d0ba with scrape type 2
2026-03-27 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c52d402e-f8fc-5235-a8e4-e43ba829d0ba, identifier: AY73779
2026-03-27 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c52d402e-f8fc-5235-a8e4-e43ba829d0ba with identifier: AY73779
2026-03-27 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c52d402e-f8fc-5235-a8e4-e43ba829d0ba with identifier: AY73779
2026-03-27 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c52d402e-f8fc-5235-a8e4-e43ba829d0ba with identifier: AY73779 to the API
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:43:12Z',
 'fuel_type': 'hybrid',
 'id': 'c52d402e-f8fc-5235-a8e4-e43ba829d0ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY73779',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 342544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-07',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2013}
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Saving data for AY73779: {'auction_closing_time': 1774716192.0, 'created_time': 1773342219.750493, 'last_price_update_time': 1774638091.785675}
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY73779') HTTP/1.1" 204 0
2026-03-27 19:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfac5c1f10>
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fe7%252F61e795d7ee127564dc29213ba5243a20%252Fpa%252FGM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg saved to cache
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7478899c-3b35-5443-9174-2cf2e2fe6689
2026-03-27 19:01:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7478899c-3b35-5443-9174-2cf2e2fe6689, skipping ID generation
2026-03-27 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7478899c-3b35-5443-9174-2cf2e2fe6689 with scrape type 1
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7478899c-3b35-5443-9174-2cf2e2fe6689 sending to next pipeline
2026-03-27 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7478899c-3b35-5443-9174-2cf2e2fe6689, identifier: GM40908
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-27 19:01:31 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-27 19:01:31 [auto1.nl] INFO: Scrape type for TL32110: 2
2026-03-27 19:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-27 19:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f13026-21b5-51ce-8e49-01aeae43c353 with scrape type 2
2026-03-27 19:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f13026-21b5-51ce-8e49-01aeae43c353 with scrape type 2
2026-03-27 19:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 33f13026-21b5-51ce-8e49-01aeae43c353, identifier: TL32110
2026-03-27 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7478899c-3b35-5443-9174-2cf2e2fe6689 with identifier: GM40908
2026-03-27 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7478899c-3b35-5443-9174-2cf2e2fe6689 with identifier: GM40908
2026-03-27 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7478899c-3b35-5443-9174-2cf2e2fe6689 with identifier: GM40908 to the API
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:23:51Z',
 'fuel_type': 'petrol',
 'id': '7478899c-3b35-5443-9174-2cf2e2fe6689',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '62-TZD-4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM40908',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'BMW',
 'model': '3er',
 'odometer': 241382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 18,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_208ca30517b43875b7833643778d7a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_2c1cadb957c36383d131556f92e38ccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_0f5ceb6fa1e3ea5e5f7f576f5123d41b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_235aef4c76f43d9f05f1d6658390a414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_6013a761fd64d5733e1205f488b3afd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_5bebe62a45d5f25dee347a908eecd95f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_ac2bfb2c5edba414741fc4ec606f06aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_29c79d126224c3c301f24978664cd1ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_66e0c5690268abdb3407ea3a84e5a66c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7478899c-3b35-5443-9174-2cf2e2fe6689/7478899c-3b35-5443-9174-2cf2e2fe6689_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86709,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/e7/61e795d7ee127564dc29213ba5243a20/pa/GM40908_1b4e65cb9fdee5cb8d9e13142c34b1e4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM40908%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Saving data for GM40908: {'created_time': 1774638092.399347, 'last_price_update_time': 1774638092.399359, 'auction_closing_time': 1774715031.0}
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM40908') HTTP/1.1" 204 0
2026-03-27 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-27 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110
2026-03-27 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 33f13026-21b5-51ce-8e49-01aeae43c353 with identifier: TL32110 to the API
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:55:30Z',
 'fuel_type': 'petrol',
 'id': '33f13026-21b5-51ce-8e49-01aeae43c353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL32110',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 126003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Saving data for TL32110: {'auction_closing_time': 1774716930.0, 'created_time': 1773231967.855925, 'last_price_update_time': 1774638092.772032}
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL32110') HTTP/1.1" 204 0
2026-03-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ead0878-2625-5a5d-8123-a3a6ee712540 with scrape type 1
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg not downloaded yet
2026-03-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d19fbe2-b437-515c-8662-fc6be36de70f with scrape type 1
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_55e89cd40f435293cec5eb3d4a688c92.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_55e89cd40f435293cec5eb3d4a688c92.jpg not downloaded yet
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Scrape type for DS12539: 1
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_12a065814aab96554d9d18e5097732e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_12a065814aab96554d9d18e5097732e5.jpg not downloaded yet
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg not downloaded yet
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Scrape type for XF65643: 0
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Scrape type for UE20026: 0
2026-03-27 19:01:32 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-27 19:01:32 [auto1.nl] INFO: Scrape type for JF28004: 2
2026-03-27 19:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-27 19:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-27 19:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-27 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 27df40ce-744c-5651-8ea7-c7b91875c664, identifier: JF28004
2026-03-27 19:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-27 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004 to the API
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:09:10Z',
 'fuel_type': 'petrol',
 'id': '27df40ce-744c-5651-8ea7-c7b91875c664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF28004',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 206099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-08',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2005}
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [auto1.nl] INFO: Saving data for JF28004: {'auction_closing_time': 1774714150.0, 'created_time': 1773947350.579692, 'last_price_update_time': 1774638093.329243}
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF28004') HTTP/1.1" 204 0
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg not downloaded yet
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_390b0f0678902c32e1051e32522325a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_390b0f0678902c32e1051e32522325a3.jpg not downloaded yet
2026-03-27 19:01:33 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-27 19:01:33 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-27 19:01:33 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-27 19:01:33 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [auto1.nl] INFO: Scrape type for FZ55104: 1
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_50b1e5044d18fea1796bebd617fc8316.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_50b1e5044d18fea1796bebd617fc8316.jpg not downloaded yet
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_30748b37b16e30e17597cc89909403b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_30748b37b16e30e17597cc89909403b1.jpg not downloaded yet
2026-03-27 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_55e89cd40f435293cec5eb3d4a688c92.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:33 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [auto1.nl] INFO: Scrape type for LF83736: 2
2026-03-27 19:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700bcd23-3a07-5548-9c4c-c5a54f656667 with identifier: LF83736
2026-03-27 19:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700bcd23-3a07-5548-9c4c-c5a54f656667 with scrape type 2
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700bcd23-3a07-5548-9c4c-c5a54f656667 with scrape type 2
2026-03-27 19:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 700bcd23-3a07-5548-9c4c-c5a54f656667, identifier: LF83736
2026-03-27 19:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 700bcd23-3a07-5548-9c4c-c5a54f656667 with identifier: LF83736
2026-03-27 19:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 700bcd23-3a07-5548-9c4c-c5a54f656667 with identifier: LF83736
2026-03-27 19:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 700bcd23-3a07-5548-9c4c-c5a54f656667 with identifier: LF83736 to the API
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-28T16:27:10Z',
 'fuel_type': 'petrol',
 'id': '700bcd23-3a07-5548-9c4c-c5a54f656667',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF83736',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 120056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-07-01',
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Luna',
 'transmission': 'automatic',
 'trim': 'Luna',
 'year': 1999}
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [auto1.nl] INFO: Saving data for LF83736: {'auction_closing_time': 1774715230.0, 'created_time': 1774440099.198319, 'last_price_update_time': 1774638093.875141}
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF83736') HTTP/1.1" 204 0
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_b8c9821b29af583be1c8433226444c71.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_b8c9821b29af583be1c8433226444c71.jpg not downloaded yet
2026-03-27 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg not downloaded yet
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: AN32414
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Scrape type for PP40573: 2
2026-03-27 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-27 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ec35913-cfa1-5c31-a236-762cf9f06c54 with scrape type 2
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ec35913-cfa1-5c31-a236-762cf9f06c54 with scrape type 2
2026-03-27 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ec35913-cfa1-5c31-a236-762cf9f06c54, identifier: PP40573
2026-03-27 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_12a065814aab96554d9d18e5097732e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-27 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573
2026-03-27 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ec35913-cfa1-5c31-a236-762cf9f06c54 with identifier: PP40573 to the API
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:13:48Z',
 'fuel_type': 'petrol',
 'id': '2ec35913-cfa1-5c31-a236-762cf9f06c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP40573',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 298248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.6 PureTech Business Plus',
 'transmission': 'automatic',
 'trim': 'Business Plus',
 'year': 2019}
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Saving data for PP40573: {'auction_closing_time': 1774714428.0, 'created_time': 1773232423.460622, 'last_price_update_time': 1774638094.501963}
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PP40573') HTTP/1.1" 204 0
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg not downloaded yet
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg not downloaded yet
2026-03-27 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Scrape type for TV49016: 0
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-27 19:01:34 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-27 19:01:34 [auto1.nl] INFO: Scrape type for GR72952: 2
2026-03-27 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-27 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with scrape type 2
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with scrape type 2
2026-03-27 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2, identifier: GR72952
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca93dd0>
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_55e89cd40f435293cec5eb3d4a688c92.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_55e89cd40f435293cec5eb3d4a688c92.jpg saved to cache
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd59950>
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg saved to cache
2026-03-27 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-27 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952
2026-03-27 19:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2 with identifier: GR72952 to the API
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:42Z',
 'fuel_type': 'diesel',
 'id': 'f52f1e78-d5a4-59f0-9f0b-6169f7c8ddd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR72952',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 223414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [auto1.nl] INFO: Saving data for GR72952: {'auction_closing_time': 1774716702.0, 'created_time': 1774551680.773495, 'last_price_update_time': 1774638095.084651}
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR72952') HTTP/1.1" 204 0
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_dc197bb0ef762613495b417882ecd73f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_dc197bb0ef762613495b417882ecd73f.jpg not downloaded yet
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_c0fa4b2ed6120b3427db071317250fd0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c0fa4b2ed6120b3427db071317250fd0.jpg not downloaded yet
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV84251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_50b1e5044d18fea1796bebd617fc8316.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9942d0>
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_12a065814aab96554d9d18e5097732e5.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_12a065814aab96554d9d18e5097732e5.jpg saved to cache
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg not downloaded yet
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_633d3e17842508a58c8479f2b1774715.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_633d3e17842508a58c8479f2b1774715.jpg not downloaded yet
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_b8c9821b29af583be1c8433226444c71.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfa036a2d0>
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg saved to cache
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_deb1b241c2905695850089dbd71c926f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_deb1b241c2905695850089dbd71c926f.jpg not downloaded yet
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_3085ffc99989d9b983cc5562b10c7f61.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_3085ffc99989d9b983cc5562b10c7f61.jpg not downloaded yet
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS12539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:35 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_841376d1ccb72c3f387181b02d7cf110.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_841376d1ccb72c3f387181b02d7cf110.jpg not downloaded yet
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg not downloaded yet
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [auto1.nl] INFO: Scrape type for NZ51488: 2
2026-03-27 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-27 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51538c51-298e-51c1-8cf3-c30dbdf8f838 with scrape type 2
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51538c51-298e-51c1-8cf3-c30dbdf8f838 with scrape type 2
2026-03-27 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51538c51-298e-51c1-8cf3-c30dbdf8f838, identifier: NZ51488
2026-03-27 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-27 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488
2026-03-27 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51538c51-298e-51c1-8cf3-c30dbdf8f838 with identifier: NZ51488 to the API
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:48:03Z',
 'fuel_type': 'petrol',
 'id': '51538c51-298e-51c1-8cf3-c30dbdf8f838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ51488',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 149349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-08',
 'seller_name': None,
 'title': 'Kia Sorento 3.5 V6 EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2004}
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [auto1.nl] INFO: Saving data for NZ51488: {'auction_closing_time': 1774716483.0, 'created_time': 1773921682.011593, 'last_price_update_time': 1774638095.872384}
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ51488') HTTP/1.1" 204 0
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8be1d0>
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_50b1e5044d18fea1796bebd617fc8316.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_50b1e5044d18fea1796bebd617fc8316.jpg saved to cache
2026-03-27 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_dc197bb0ef762613495b417882ecd73f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-27 19:01:35 [auto1.nl] INFO: Scrape type for HM04115: 0
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-27 19:01:35 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-27 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL39193%27 HTTP/1.1" 200 None
2026-03-27 19:01:36 [auto1.nl] INFO: Scrape type for EL39193: 1
2026-03-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c0fa4b2ed6120b3427db071317250fd0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca45bd0>
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg saved to cache
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd5a210>
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_b8c9821b29af583be1c8433226444c71.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_b8c9821b29af583be1c8433226444c71.jpg saved to cache
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_633d3e17842508a58c8479f2b1774715.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-27 19:01:36 [auto1.nl] INFO: Scrape type for US61568: 2
2026-03-27 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with identifier: US61568
2026-03-27 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with scrape type 2
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with scrape type 2
2026-03-27 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa, identifier: US61568
2026-03-27 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with identifier: US61568
2026-03-27 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with identifier: US61568
2026-03-27 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa with identifier: US61568 to the API
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '4a8f0bb6-4ae4-5dc0-a6e5-1a846ee5e3fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61568',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 227333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-27 19:01:36 [auto1.nl] INFO: Saving data for US61568: {'auction_closing_time': 1774716173.0, 'created_time': 1773860719.29232, 'last_price_update_time': 1774638096.545443}
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='US61568') HTTP/1.1" 204 0
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-27 19:01:36 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-27 19:01:36 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-27 19:01:36 [auto1.nl] INFO: Scrape type for PZ45874: 2
2026-03-27 19:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-27 19:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with scrape type 2
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with scrape type 2
2026-03-27 19:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875, identifier: PZ45874
2026-03-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ55104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9d826b50>
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_dc197bb0ef762613495b417882ecd73f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_dc197bb0ef762613495b417882ecd73f.jpg saved to cache
2026-03-27 19:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_deb1b241c2905695850089dbd71c926f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-27 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874
2026-03-27 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ac791dc7-c36c-5b6a-adc2-c53dbf6e5875 with identifier: PZ45874 to the API
2026-03-27 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:30:37Z',
 'fuel_type': 'hybrid',
 'id': 'ac791dc7-c36c-5b6a-adc2-c53dbf6e5875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ45874',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 113916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-27 19:01:37 [auto1.nl] INFO: Saving data for PZ45874: {'auction_closing_time': 1774715437.0, 'created_time': 1774551640.605072, 'last_price_update_time': 1774638097.127672}
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PZ45874') HTTP/1.1" 204 0
2026-03-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_3085ffc99989d9b983cc5562b10c7f61.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-27 19:01:37 [auto1.nl] INFO: Scrape type for WH77322: 2
2026-03-27 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69575c38-984f-505c-a10f-6509c7114c79 with identifier: WH77322
2026-03-27 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69575c38-984f-505c-a10f-6509c7114c79 with scrape type 2
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69575c38-984f-505c-a10f-6509c7114c79 with scrape type 2
2026-03-27 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69575c38-984f-505c-a10f-6509c7114c79, identifier: WH77322
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd66750>
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg saved to cache
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff7e790>
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_c0fa4b2ed6120b3427db071317250fd0.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c0fa4b2ed6120b3427db071317250fd0.jpg saved to cache
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff8f4d0>
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_633d3e17842508a58c8479f2b1774715.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_633d3e17842508a58c8479f2b1774715.jpg saved to cache
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69575c38-984f-505c-a10f-6509c7114c79 with identifier: WH77322
2026-03-27 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69575c38-984f-505c-a10f-6509c7114c79 with identifier: WH77322
2026-03-27 19:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69575c38-984f-505c-a10f-6509c7114c79 with identifier: WH77322 to the API
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:03:52Z',
 'fuel_type': 'electro',
 'id': '69575c38-984f-505c-a10f-6509c7114c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH77322',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 250e Electric Drive Standard',
 'transmission': 'automatic',
 'trim': 'Standard',
 'year': 2016}
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-27 19:01:37 [auto1.nl] INFO: Saving data for WH77322: {'auction_closing_time': 1774713832.0, 'created_time': 1774440072.20822, 'last_price_update_time': 1774638097.709423}
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WH77322') HTTP/1.1" 204 0
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-27 19:01:37 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-27 19:01:37 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN36525%27 HTTP/1.1" 200 None
2026-03-27 19:01:37 [auto1.nl] INFO: Scrape type for VN36525: 2
2026-03-27 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66a1d174-d03a-55e7-97b6-aa7384a57be1 with identifier: VN36525
2026-03-27 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66a1d174-d03a-55e7-97b6-aa7384a57be1 with scrape type 2
2026-03-27 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66a1d174-d03a-55e7-97b6-aa7384a57be1 with scrape type 2
2026-03-27 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 66a1d174-d03a-55e7-97b6-aa7384a57be1, identifier: VN36525
2026-03-27 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 66a1d174-d03a-55e7-97b6-aa7384a57be1 with identifier: VN36525
2026-03-27 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 66a1d174-d03a-55e7-97b6-aa7384a57be1 with identifier: VN36525
2026-03-27 19:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 66a1d174-d03a-55e7-97b6-aa7384a57be1 with identifier: VN36525 to the API
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:54:56Z',
 'fuel_type': 'petrol',
 'id': '66a1d174-d03a-55e7-97b6-aa7384a57be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN36525',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 177211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-02',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Climbing 4x4',
 'transmission': 'manual',
 'trim': 'Climbing 4x4',
 'year': 2005}
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN36525%27 HTTP/1.1" 200 None
2026-03-27 19:01:38 [auto1.nl] INFO: Saving data for VN36525: {'auction_closing_time': 1774716896.0, 'created_time': 1773232248.827344, 'last_price_update_time': 1774638098.28503}
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VN36525') HTTP/1.1" 204 0
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9118d0>
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_deb1b241c2905695850089dbd71c926f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_deb1b241c2905695850089dbd71c926f.jpg saved to cache
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca1f6d0>
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_3085ffc99989d9b983cc5562b10c7f61.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_3085ffc99989d9b983cc5562b10c7f61.jpg saved to cache
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca59b90>
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg saved to cache
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff39c50>
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg saved to cache
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_841376d1ccb72c3f387181b02d7cf110.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-27 19:01:38 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-27 19:01:38 [auto1.nl] INFO: Scrape type for PM08403: 2
2026-03-27 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35500430-a334-5afe-b084-040851d677a2 with identifier: PM08403
2026-03-27 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35500430-a334-5afe-b084-040851d677a2 with scrape type 2
2026-03-27 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35500430-a334-5afe-b084-040851d677a2 with scrape type 2
2026-03-27 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 35500430-a334-5afe-b084-040851d677a2, identifier: PM08403
2026-03-27 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 35500430-a334-5afe-b084-040851d677a2 with identifier: PM08403
2026-03-27 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 35500430-a334-5afe-b084-040851d677a2 with identifier: PM08403
2026-03-27 19:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 35500430-a334-5afe-b084-040851d677a2 with identifier: PM08403 to the API
2026-03-27 19:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:01:33Z',
 'fuel_type': 'diesel',
 'id': '35500430-a334-5afe-b084-040851d677a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM08403',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 175641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-28',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Express Maxi Load',
 'transmission': 'manual',
 'trim': 'Express Maxi Load',
 'year': 2006}
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Saving data for PM08403: {'auction_closing_time': 1774713693.0, 'created_time': 1774440048.87707, 'last_price_update_time': 1774638099.181094}
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PM08403') HTTP/1.1" 204 0
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-27 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV84251> (referer: https://www.auto1.com/v1/car-details-view/WV84251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL39193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9e9396d0>
2026-03-27 19:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fb7%252F0cb7172ffb9774af83c303b48dba683c%252Fpa%252FHZ82321_841376d1ccb72c3f387181b02d7cf110.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_841376d1ccb72c3f387181b02d7cf110.jpg saved to cache
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ead0878-2625-5a5d-8123-a3a6ee712540
2026-03-27 19:01:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ead0878-2625-5a5d-8123-a3a6ee712540, skipping ID generation
2026-03-27 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ead0878-2625-5a5d-8123-a3a6ee712540 with scrape type 1
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ead0878-2625-5a5d-8123-a3a6ee712540 sending to next pipeline
2026-03-27 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ead0878-2625-5a5d-8123-a3a6ee712540, identifier: HZ82321
2026-03-27 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321
2026-03-27 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ead0878-2625-5a5d-8123-a3a6ee712540 with identifier: HZ82321 to the API
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_841376d1ccb72c3f387181b02d7cf110.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:34:19Z',
 'fuel_type': 'diesel',
 'id': '4ead0878-2625-5a5d-8123-a3a6ee712540',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RF390L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ82321',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'BMW',
 'model': '3er',
 'odometer': 174390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_9b2783714d999af0c356f3478f1f6fd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_12a065814aab96554d9d18e5097732e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_1ec8e9ab08e60f9323e346e3d7a39c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_50b1e5044d18fea1796bebd617fc8316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_b8c9821b29af583be1c8433226444c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_afbce45ffa32a009ec230fa7ab85e2a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_dc197bb0ef762613495b417882ecd73f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_f928ce8e228c87ce473205ffbfc670e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_deb1b241c2905695850089dbd71c926f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ead0878-2625-5a5d-8123-a3a6ee712540/4ead0878-2625-5a5d-8123-a3a6ee712540_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/b7/0cb7172ffb9774af83c303b48dba683c/pa/HZ82321_841376d1ccb72c3f387181b02d7cf110.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Saving data for HZ82321: {'created_time': 1774638099.645311, 'last_price_update_time': 1774638099.645321, 'auction_closing_time': 1774715659.0}
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ82321') HTTP/1.1" 204 0
2026-03-27 19:01:39 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a826134e-57fc-575d-bb55-342bee867644 with identifier: WV84251
2026-03-27 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a826134e-57fc-575d-bb55-342bee867644 with scrape type 1
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg not downloaded yet
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Scrape type for LX95579: 0
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Scrape type for KK04481: 0
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-27 19:01:39 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [auto1.nl] INFO: Scrape type for GT27619: 2
2026-03-27 19:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with identifier: GT27619
2026-03-27 19:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with scrape type 2
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with scrape type 2
2026-03-27 19:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5, identifier: GT27619
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_08053da3943c822f3de73dfd9700c655.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_08053da3943c822f3de73dfd9700c655.jpg not downloaded yet
2026-03-27 19:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with identifier: GT27619
2026-03-27 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with identifier: GT27619
2026-03-27 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 44bdbecb-1a04-5afb-a90e-ae7e5769e6c5 with identifier: GT27619 to the API
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:21:27Z',
 'fuel_type': 'hybrid',
 'id': '44bdbecb-1a04-5afb-a90e-ae7e5769e6c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT27619',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 240901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-31',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV Instyle Diamond 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle Diamond 4WD',
 'year': 2014}
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Saving data for GT27619: {'auction_closing_time': 1774714887.0, 'created_time': 1774440067.90817, 'last_price_update_time': 1774638100.265347}
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GT27619') HTTP/1.1" 204 0
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Scrape type for BU17435: 0
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH97185%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Scrape type for FH97185: 2
2026-03-27 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61d30ae2-63ee-5192-9c03-9a78a7157178 with identifier: FH97185
2026-03-27 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61d30ae2-63ee-5192-9c03-9a78a7157178 with scrape type 2
2026-03-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61d30ae2-63ee-5192-9c03-9a78a7157178 with scrape type 2
2026-03-27 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 61d30ae2-63ee-5192-9c03-9a78a7157178, identifier: FH97185
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_dae40c96f5b8924b5178ef42a5e77698.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_dae40c96f5b8924b5178ef42a5e77698.jpg not downloaded yet
2026-03-27 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 61d30ae2-63ee-5192-9c03-9a78a7157178 with identifier: FH97185
2026-03-27 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 61d30ae2-63ee-5192-9c03-9a78a7157178 with identifier: FH97185
2026-03-27 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 61d30ae2-63ee-5192-9c03-9a78a7157178 with identifier: FH97185 to the API
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:16Z',
 'fuel_type': 'petrol',
 'id': '61d30ae2-63ee-5192-9c03-9a78a7157178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH97185',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 182747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-12',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2018}
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH97185%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Saving data for FH97185: {'auction_closing_time': 1774713916.0, 'created_time': 1774378908.066381, 'last_price_update_time': 1774638100.808631}
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH97185') HTTP/1.1" 204 0
2026-03-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS12539> (referer: https://www.auto1.com/v1/car-details-view/DS12539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Scrape type for GG50012: 1
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_e422db94d252117d8ab5a27c1470fa8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e422db94d252117d8ab5a27c1470fa8c.jpg not downloaded yet
2026-03-27 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Scrape type for WV31023: 0
2026-03-27 19:01:40 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-27 19:01:40 [auto1.nl] INFO: Scrape type for NH92548: 2
2026-03-27 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32532f2c-91cc-563d-ac12-350cd8482b1c with identifier: NH92548
2026-03-27 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32532f2c-91cc-563d-ac12-350cd8482b1c with scrape type 2
2026-03-27 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32532f2c-91cc-563d-ac12-350cd8482b1c with scrape type 2
2026-03-27 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32532f2c-91cc-563d-ac12-350cd8482b1c, identifier: NH92548
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_7bf66f959e19870317aa476365af6edd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_7bf66f959e19870317aa476365af6edd.jpg not downloaded yet
2026-03-27 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32532f2c-91cc-563d-ac12-350cd8482b1c with identifier: NH92548
2026-03-27 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32532f2c-91cc-563d-ac12-350cd8482b1c with identifier: NH92548
2026-03-27 19:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32532f2c-91cc-563d-ac12-350cd8482b1c with identifier: NH92548 to the API
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:49:19Z',
 'fuel_type': 'petrol',
 'id': '32532f2c-91cc-563d-ac12-350cd8482b1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH92548',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Tercel',
 'odometer': 133435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1983-08-31',
 'seller_name': None,
 'title': 'Toyota Tercel 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 1983}
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Saving data for NH92548: {'auction_closing_time': 1774716559.0, 'created_time': 1774465240.068241, 'last_price_update_time': 1774638101.300481}
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH92548') HTTP/1.1" 204 0
2026-03-27 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_08053da3943c822f3de73dfd9700c655.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_dae40c96f5b8924b5178ef42a5e77698.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:41 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Scrape type for KC46486: 2
2026-03-27 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ee8bbc-d44b-56a4-8ea7-083eca294114 with identifier: KC46486
2026-03-27 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ee8bbc-d44b-56a4-8ea7-083eca294114 with scrape type 2
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ee8bbc-d44b-56a4-8ea7-083eca294114 with scrape type 2
2026-03-27 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34ee8bbc-d44b-56a4-8ea7-083eca294114, identifier: KC46486
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_6ff90774abee93ba02006a4a4d157bac.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6ff90774abee93ba02006a4a4d157bac.jpg not downloaded yet
2026-03-27 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_390b0f0678902c32e1051e32522325a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34ee8bbc-d44b-56a4-8ea7-083eca294114 with identifier: KC46486
2026-03-27 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34ee8bbc-d44b-56a4-8ea7-083eca294114 with identifier: KC46486
2026-03-27 19:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34ee8bbc-d44b-56a4-8ea7-083eca294114 with identifier: KC46486 to the API
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': '34ee8bbc-d44b-56a4-8ea7-083eca294114',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC46486',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 328515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-01',
 'seller_name': None,
 'title': 'Ford Mondeo 1.6 EcoBoost Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2013}
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Saving data for KC46486: {'auction_closing_time': 1774715428.0, 'created_time': 1774440094.29268, 'last_price_update_time': 1774638101.700734}
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC46486') HTTP/1.1" 204 0
2026-03-27 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-27 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d999b2-4cbe-5518-89c1-1a68def3a899 with scrape type 1
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a7d999b2-4cbe-5518-89c1-1a68def3a899
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F56%252F9a56ccd111bed2945576d5727322b714%252Fpa%252FDS12539_e5ce1694cbc6bb916fda8280a7ceb085.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_e5ce1694cbc6bb916fda8280a7ceb085.jpg already downloaded
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F56%252F9a56ccd111bed2945576d5727322b714%252Fpa%252FDS12539_b7ef699836ae8fe816e7d7a2647b5302.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_b7ef699836ae8fe816e7d7a2647b5302.jpg already downloaded
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F56%252F9a56ccd111bed2945576d5727322b714%252Fpa%252FDS12539_415e24675c3d6e6b3220e316febf037c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_415e24675c3d6e6b3220e316febf037c.jpg already downloaded
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F56%252F9a56ccd111bed2945576d5727322b714%252Fpa%252FDS12539_a2637dff02ebf1715d3f6d51bfaeb4f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_a2637dff02ebf1715d3f6d51bfaeb4f1.jpg already downloaded
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F56%252F9a56ccd111bed2945576d5727322b714%252Fpa%252FDS12539_9c598c8cd39bf151df22f8389ebd1ced.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_9c598c8cd39bf151df22f8389ebd1ced.jpg already downloaded
2026-03-27 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7d999b2-4cbe-5518-89c1-1a68def3a899, identifier: DS12539
2026-03-27 19:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb5da90>
2026-03-27 19:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg saved to cache
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:41 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Scrape type for BE07790: 0
2026-03-27 19:01:41 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Scrape type for WK39469: 0
2026-03-27 19:01:41 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-27 19:01:41 [auto1.nl] INFO: Scrape type for CP88423: 2
2026-03-27 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-27 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-27 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-27 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f, identifier: CP88423
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg not downloaded yet
2026-03-27 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-27 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-27 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539 to the API
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS12539>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:51:41Z',
 'fuel_type': 'petrol',
 'id': 'a7d999b2-4cbe-5518-89c1-1a68def3a899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '96TTXS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS12539',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 214910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_e5ce1694cbc6bb916fda8280a7ceb085.jpg',
                'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_b7ef699836ae8fe816e7d7a2647b5302.jpg',
                'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_415e24675c3d6e6b3220e316febf037c.jpg',
                'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_a2637dff02ebf1715d3f6d51bfaeb4f1.jpg',
                'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_9c598c8cd39bf151df22f8389ebd1ced.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d999b2-4cbe-5518-89c1-1a68def3a899/a7d999b2-4cbe-5518-89c1-1a68def3a899_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_e5ce1694cbc6bb916fda8280a7ceb085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d999b2-4cbe-5518-89c1-1a68def3a899/a7d999b2-4cbe-5518-89c1-1a68def3a899_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_b7ef699836ae8fe816e7d7a2647b5302.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d999b2-4cbe-5518-89c1-1a68def3a899/a7d999b2-4cbe-5518-89c1-1a68def3a899_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_415e24675c3d6e6b3220e316febf037c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d999b2-4cbe-5518-89c1-1a68def3a899/a7d999b2-4cbe-5518-89c1-1a68def3a899_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_a2637dff02ebf1715d3f6d51bfaeb4f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d999b2-4cbe-5518-89c1-1a68def3a899/a7d999b2-4cbe-5518-89c1-1a68def3a899_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/56/9a56ccd111bed2945576d5727322b714/pa/DS12539_9c598c8cd39bf151df22f8389ebd1ced.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-02-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-27 19:01:42 [auto1.nl] INFO: Saving data for DS12539: {'created_time': 1774638102.382682, 'last_price_update_time': 1774638102.382692, 'auction_closing_time': 1774716701.0}
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS12539') HTTP/1.1" 204 0
2026-03-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e422db94d252117d8ab5a27c1470fa8c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-27 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-27 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423 to the API
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'petrol',
 'id': 'dfec76ea-b5ec-5e5a-b119-d4d79c8f197f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP88423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 227968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-28',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2007}
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-27 19:01:42 [auto1.nl] INFO: Saving data for CP88423: {'auction_closing_time': 1774714694.0, 'created_time': 1774378898.86484, 'last_price_update_time': 1774638102.748753}
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP88423') HTTP/1.1" 204 0
2026-03-27 19:01:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca7a750>
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg saved to cache
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9ef90>
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_08053da3943c822f3de73dfd9700c655.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_08053da3943c822f3de73dfd9700c655.jpg saved to cache
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c979690>
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_dae40c96f5b8924b5178ef42a5e77698.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_dae40c96f5b8924b5178ef42a5e77698.jpg saved to cache
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_7bf66f959e19870317aa476365af6edd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:42 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-27 19:01:42 [auto1.nl] INFO: Scrape type for VA53958: 2
2026-03-27 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172d2e96-b47e-57d8-a720-89f1fffa95ea with identifier: VA53958
2026-03-27 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 172d2e96-b47e-57d8-a720-89f1fffa95ea with scrape type 2
2026-03-27 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 172d2e96-b47e-57d8-a720-89f1fffa95ea with scrape type 2
2026-03-27 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 172d2e96-b47e-57d8-a720-89f1fffa95ea, identifier: VA53958
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg not downloaded yet
2026-03-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ55104> (referer: https://www.auto1.com/v1/car-details-view/FZ55104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 172d2e96-b47e-57d8-a720-89f1fffa95ea with identifier: VA53958
2026-03-27 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 172d2e96-b47e-57d8-a720-89f1fffa95ea with identifier: VA53958
2026-03-27 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 172d2e96-b47e-57d8-a720-89f1fffa95ea with identifier: VA53958 to the API
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:36Z',
 'fuel_type': 'petrol',
 'id': '172d2e96-b47e-57d8-a720-89f1fffa95ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA53958',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 191716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-30',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2017}
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-27 19:01:43 [auto1.nl] INFO: Saving data for VA53958: {'auction_closing_time': 1774715796.0, 'created_time': 1774440058.267712, 'last_price_update_time': 1774638103.424432}
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VA53958') HTTP/1.1" 204 0
2026-03-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL39193> (referer: https://www.auto1.com/v1/car-details-view/EL39193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:43 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-27 19:01:43 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-27 19:01:43 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-27 19:01:43 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-27 19:01:43 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-27 19:01:43 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-27 19:01:43 [auto1.nl] INFO: Scrape type for MF32327: 2
2026-03-27 19:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-27 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99d595f6-0392-5309-bc2e-9a41e4310ef3 with scrape type 2
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99d595f6-0392-5309-bc2e-9a41e4310ef3 with scrape type 2
2026-03-27 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99d595f6-0392-5309-bc2e-9a41e4310ef3, identifier: MF32327
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_e38871e419099d873b76ab971856978f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e38871e419099d873b76ab971856978f.jpg not downloaded yet
2026-03-27 19:01:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c99f810>
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_390b0f0678902c32e1051e32522325a3.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_390b0f0678902c32e1051e32522325a3.jpg saved to cache
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca534d0>
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_e422db94d252117d8ab5a27c1470fa8c.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e422db94d252117d8ab5a27c1470fa8c.jpg saved to cache
2026-03-27 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_30748b37b16e30e17597cc89909403b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-27 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327
2026-03-27 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99d595f6-0392-5309-bc2e-9a41e4310ef3 with identifier: MF32327 to the API
2026-03-27 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:31:48Z',
 'fuel_type': 'diesel',
 'id': '99d595f6-0392-5309-bc2e-9a41e4310ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF32327',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 159354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2015}
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [auto1.nl] INFO: Saving data for MF32327: {'auction_closing_time': 1774715508.0, 'created_time': 1773688306.249277, 'last_price_update_time': 1774638104.132958}
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MF32327') HTTP/1.1" 204 0
2026-03-27 19:01:44 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC37182%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [auto1.nl] INFO: Scrape type for HC37182: 2
2026-03-27 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de10efc3-0a0f-5c01-a2f5-f96b1045a547 with identifier: HC37182
2026-03-27 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de10efc3-0a0f-5c01-a2f5-f96b1045a547 with scrape type 2
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de10efc3-0a0f-5c01-a2f5-f96b1045a547 with scrape type 2
2026-03-27 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de10efc3-0a0f-5c01-a2f5-f96b1045a547, identifier: HC37182
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_642a95c52ba540ca06cf6417a07e29d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_642a95c52ba540ca06cf6417a07e29d2.jpg not downloaded yet
2026-03-27 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de10efc3-0a0f-5c01-a2f5-f96b1045a547 with identifier: HC37182
2026-03-27 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de10efc3-0a0f-5c01-a2f5-f96b1045a547 with identifier: HC37182
2026-03-27 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de10efc3-0a0f-5c01-a2f5-f96b1045a547 with identifier: HC37182 to the API
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:48:02Z',
 'fuel_type': 'petrol',
 'id': 'de10efc3-0a0f-5c01-a2f5-f96b1045a547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC37182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 64397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-28',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion',
 'year': 2018}
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC37182%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [auto1.nl] INFO: Saving data for HC37182: {'auction_closing_time': 1774716482.0, 'created_time': 1774465265.319582, 'last_price_update_time': 1774638104.814009}
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HC37182') HTTP/1.1" 204 0
2026-03-27 19:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb472d0>
2026-03-27 19:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_7bf66f959e19870317aa476365af6edd.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_7bf66f959e19870317aa476365af6edd.jpg saved to cache
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca06f666-fdd3-51d6-a349-f9f04d3c6a97 with identifier: FZ55104
2026-03-27 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca06f666-fdd3-51d6-a349-f9f04d3c6a97 with scrape type 1
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ca06f666-fdd3-51d6-a349-f9f04d3c6a97
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_f11c283e83a2878dbee60d0b25599ada.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f11c283e83a2878dbee60d0b25599ada.jpg already downloaded
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_17559ab21646f940e2ef10e741fd12cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_17559ab21646f940e2ef10e741fd12cb.jpg already downloaded
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_60a0c88b4e03b100dae1228e30f81198.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_60a0c88b4e03b100dae1228e30f81198.jpg already downloaded
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_f08da408f56b03c47094070ceed03131.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f08da408f56b03c47094070ceed03131.jpg already downloaded
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_84cfa2f6938f55bb0af464aed6efea42.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_84cfa2f6938f55bb0af464aed6efea42.jpg already downloaded
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_82e84b293e877ae67462615c9cad4324.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_82e84b293e877ae67462615c9cad4324.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_5cf5e09896e294ff0a647d7584a46799.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_5cf5e09896e294ff0a647d7584a46799.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_24ea51240c8d37d3e37681249f3b29a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_24ea51240c8d37d3e37681249f3b29a0.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_1b201df65637b82fff7e7b5f6b623dba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_1b201df65637b82fff7e7b5f6b623dba.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F55%252F9d55441fe33b6299488a965dd605094a%252Fpa%252FFZ55104_e6a5ab556a16dbef6bc20c464f40fa47.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_e6a5ab556a16dbef6bc20c464f40fa47.jpg already downloaded
2026-03-27 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ca06f666-fdd3-51d6-a349-f9f04d3c6a97, identifier: FZ55104
2026-03-27 19:01:45 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38bb3143-6122-50ec-834d-0f13aba77215 with identifier: EL39193
2026-03-27 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bb3143-6122-50ec-834d-0f13aba77215 with scrape type 1
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 38bb3143-6122-50ec-834d-0f13aba77215
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F49%252F3749f8a604b3d9a82ca4ecf9e371abf6%252Fpa%252FEL39193_b1f19774abefb0270b062279201341dc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_b1f19774abefb0270b062279201341dc.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F49%252F3749f8a604b3d9a82ca4ecf9e371abf6%252Fpa%252FEL39193_618da10ff1cfcef09fc2b9045a6350ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_618da10ff1cfcef09fc2b9045a6350ce.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F49%252F3749f8a604b3d9a82ca4ecf9e371abf6%252Fpa%252FEL39193_9ac84202c234c01f48063267ccc555d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_9ac84202c234c01f48063267ccc555d5.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F49%252F3749f8a604b3d9a82ca4ecf9e371abf6%252Fpa%252FEL39193_f95be04d5934ecb35c7ba171816327bf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_f95be04d5934ecb35c7ba171816327bf.jpg already downloaded
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg37%252F49%252F3749f8a604b3d9a82ca4ecf9e371abf6%252Fpa%252FEL39193_69bc547da24d6cdbcb30a04f781f47af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_69bc547da24d6cdbcb30a04f781f47af.jpg already downloaded
2026-03-27 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38bb3143-6122-50ec-834d-0f13aba77215, identifier: EL39193
2026-03-27 19:01:45 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-27 19:01:45 [auto1.nl] INFO: Scrape type for AJ89396: 2
2026-03-27 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-27 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-27 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-27 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69bb4fe5-7790-5c11-b0ba-6682de008784, identifier: AJ89396
2026-03-27 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ca06f666-fdd3-51d6-a349-f9f04d3c6a97 with identifier: FZ55104
2026-03-27 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ca06f666-fdd3-51d6-a349-f9f04d3c6a97 with identifier: FZ55104
2026-03-27 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ca06f666-fdd3-51d6-a349-f9f04d3c6a97 with identifier: FZ55104 to the API
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FZ55104>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:27:03Z',
 'fuel_type': 'petrol',
 'id': 'ca06f666-fdd3-51d6-a349-f9f04d3c6a97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '70JJB3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ55104',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 196017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f11c283e83a2878dbee60d0b25599ada.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_17559ab21646f940e2ef10e741fd12cb.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_60a0c88b4e03b100dae1228e30f81198.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f08da408f56b03c47094070ceed03131.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_84cfa2f6938f55bb0af464aed6efea42.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_82e84b293e877ae67462615c9cad4324.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_5cf5e09896e294ff0a647d7584a46799.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_24ea51240c8d37d3e37681249f3b29a0.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_1b201df65637b82fff7e7b5f6b623dba.jpg',
                'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_e6a5ab556a16dbef6bc20c464f40fa47.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f11c283e83a2878dbee60d0b25599ada.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_17559ab21646f940e2ef10e741fd12cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_60a0c88b4e03b100dae1228e30f81198.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_f08da408f56b03c47094070ceed03131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_84cfa2f6938f55bb0af464aed6efea42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_82e84b293e877ae67462615c9cad4324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_5cf5e09896e294ff0a647d7584a46799.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_24ea51240c8d37d3e37681249f3b29a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_1b201df65637b82fff7e7b5f6b623dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca06f666-fdd3-51d6-a349-f9f04d3c6a97/ca06f666-fdd3-51d6-a349-f9f04d3c6a97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/55/9d55441fe33b6299488a965dd605094a/pa/FZ55104_e6a5ab556a16dbef6bc20c464f40fa47.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-27 19:01:46 [auto1.nl] INFO: Saving data for FZ55104: {'created_time': 1774638106.124631, 'last_price_update_time': 1774638106.124643, 'auction_closing_time': 1774715223.0}
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FZ55104') HTTP/1.1" 204 0
2026-03-27 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38bb3143-6122-50ec-834d-0f13aba77215 with identifier: EL39193
2026-03-27 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38bb3143-6122-50ec-834d-0f13aba77215 with identifier: EL39193
2026-03-27 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38bb3143-6122-50ec-834d-0f13aba77215 with identifier: EL39193 to the API
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EL39193>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:41Z',
 'fuel_type': 'petrol',
 'id': '38bb3143-6122-50ec-834d-0f13aba77215',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JX307H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL39193',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 290084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_b1f19774abefb0270b062279201341dc.jpg',
                'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_618da10ff1cfcef09fc2b9045a6350ce.jpg',
                'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_9ac84202c234c01f48063267ccc555d5.jpg',
                'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_f95be04d5934ecb35c7ba171816327bf.jpg',
                'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_69bc547da24d6cdbcb30a04f781f47af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bb3143-6122-50ec-834d-0f13aba77215/38bb3143-6122-50ec-834d-0f13aba77215_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_b1f19774abefb0270b062279201341dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bb3143-6122-50ec-834d-0f13aba77215/38bb3143-6122-50ec-834d-0f13aba77215_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_618da10ff1cfcef09fc2b9045a6350ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bb3143-6122-50ec-834d-0f13aba77215/38bb3143-6122-50ec-834d-0f13aba77215_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_9ac84202c234c01f48063267ccc555d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bb3143-6122-50ec-834d-0f13aba77215/38bb3143-6122-50ec-834d-0f13aba77215_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_f95be04d5934ecb35c7ba171816327bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bb3143-6122-50ec-834d-0f13aba77215/38bb3143-6122-50ec-834d-0f13aba77215_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img37/49/3749f8a604b3d9a82ca4ecf9e371abf6/pa/EL39193_69bc547da24d6cdbcb30a04f781f47af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL39193%27 HTTP/1.1" 200 None
2026-03-27 19:01:46 [auto1.nl] INFO: Saving data for EL39193: {'created_time': 1774638106.682279, 'last_price_update_time': 1774638106.68229, 'auction_closing_time': 1774713821.0}
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL39193') HTTP/1.1" 204 0
2026-03-27 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-27 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-27 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396 to the API
2026-03-27 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:01Z',
 'fuel_type': 'petrol',
 'id': '69bb4fe5-7790-5c11-b0ba-6682de008784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ89396',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 177834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-06',
 'seller_name': None,
 'title': 'Kia Carens 2.0 EX Van',
 'transmission': 'manual',
 'trim': 'EX Van',
 'year': 2005}
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-27 19:01:47 [auto1.nl] INFO: Saving data for AJ89396: {'auction_closing_time': 1774716781.0, 'created_time': 1773749265.064177, 'last_price_update_time': 1774638107.396288}
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ89396') HTTP/1.1" 204 0
2026-03-27 19:01:47 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-27 19:01:47 [auto1.nl] INFO: Scrape type for DX40194: 0
2026-03-27 19:01:47 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-27 19:01:47 [auto1.nl] INFO: Scrape type for HB03885: 1
2026-03-27 19:01:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c974190>
2026-03-27 19:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_30748b37b16e30e17597cc89909403b1.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_30748b37b16e30e17597cc89909403b1.jpg saved to cache
2026-03-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:47 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-27 19:01:47 [auto1.nl] INFO: Scrape type for GD14705: 2
2026-03-27 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-27 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 108c6f11-35df-560a-8a66-ea74a782e3a5 with scrape type 2
2026-03-27 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 108c6f11-35df-560a-8a66-ea74a782e3a5 with scrape type 2
2026-03-27 19:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 108c6f11-35df-560a-8a66-ea74a782e3a5, identifier: GD14705
2026-03-27 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-27 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705
2026-03-27 19:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 108c6f11-35df-560a-8a66-ea74a782e3a5 with identifier: GD14705 to the API
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:06:56Z',
 'fuel_type': 'petrol',
 'id': '108c6f11-35df-560a-8a66-ea74a782e3a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD14705',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 91407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Saving data for GD14705: {'auction_closing_time': 1774714016.0, 'created_time': 1774551643.226041, 'last_price_update_time': 1774638108.072396}
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD14705') HTTP/1.1" 204 0
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB40041%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Scrape type for WB40041: 1
2026-03-27 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e38871e419099d873b76ab971856978f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6ff90774abee93ba02006a4a4d157bac.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT04767%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Scrape type for CT04767: 1
2026-03-27 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Scrape type for GR22460: 1
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Scrape type for DM27085: 2
2026-03-27 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03569dbd-0f94-51ab-b1e0-5526579083cc with identifier: DM27085
2026-03-27 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03569dbd-0f94-51ab-b1e0-5526579083cc with scrape type 2
2026-03-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03569dbd-0f94-51ab-b1e0-5526579083cc with scrape type 2
2026-03-27 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03569dbd-0f94-51ab-b1e0-5526579083cc, identifier: DM27085
2026-03-27 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd23550>
2026-03-27 19:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F36%252Fb236d2a70902ad72a347f8dc158373c8%252Fpa%252FEM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg saved to cache
2026-03-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d19fbe2-b437-515c-8662-fc6be36de70f
2026-03-27 19:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d19fbe2-b437-515c-8662-fc6be36de70f, skipping ID generation
2026-03-27 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d19fbe2-b437-515c-8662-fc6be36de70f with scrape type 1
2026-03-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d19fbe2-b437-515c-8662-fc6be36de70f sending to next pipeline
2026-03-27 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d19fbe2-b437-515c-8662-fc6be36de70f, identifier: EM66057
2026-03-27 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03569dbd-0f94-51ab-b1e0-5526579083cc with identifier: DM27085
2026-03-27 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03569dbd-0f94-51ab-b1e0-5526579083cc with identifier: DM27085
2026-03-27 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03569dbd-0f94-51ab-b1e0-5526579083cc with identifier: DM27085 to the API
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:33:49Z',
 'fuel_type': 'petrol',
 'id': '03569dbd-0f94-51ab-b1e0-5526579083cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM27085',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2018}
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Saving data for DM27085: {'auction_closing_time': 1774715629.0, 'created_time': 1773131981.813717, 'last_price_update_time': 1774638108.918638}
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DM27085') HTTP/1.1" 204 0
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-27 19:01:48 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-27 19:01:48 [auto1.nl] INFO: Scrape type for UV51543: 2
2026-03-27 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-27 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de1bd27-bd00-57ea-8e40-264c08ec4759 with scrape type 2
2026-03-27 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6de1bd27-bd00-57ea-8e40-264c08ec4759 with scrape type 2
2026-03-27 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6de1bd27-bd00-57ea-8e40-264c08ec4759, identifier: UV51543
2026-03-27 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-27 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057
2026-03-27 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d19fbe2-b437-515c-8662-fc6be36de70f with identifier: EM66057 to the API
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:17:11Z',
 'fuel_type': 'petrol',
 'id': '7d19fbe2-b437-515c-8662-fc6be36de70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TN624V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM66057',
 'listing': 'auction',
 'location': 'NL, Goes',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 218782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_55e89cd40f435293cec5eb3d4a688c92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c6e700d09e4b373502527e7ad64ed3cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2563152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_390b0f0678902c32e1051e32522325a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2791838,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_30748b37b16e30e17597cc89909403b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68762,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_64605c7bd84b5d1cfff28ef84e66b346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_d3b40b6ef33be188b130f3a6be9ec6af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_c0fa4b2ed6120b3427db071317250fd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_633d3e17842508a58c8479f2b1774715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_3085ffc99989d9b983cc5562b10c7f61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d19fbe2-b437-515c-8662-fc6be36de70f/7d19fbe2-b437-515c-8662-fc6be36de70f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/36/b236d2a70902ad72a347f8dc158373c8/pa/EM66057_5a8fd4e37ec401f5e92f8dbe34358616.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2013}
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-27 19:01:49 [auto1.nl] INFO: Saving data for EM66057: {'created_time': 1774638109.348845, 'last_price_update_time': 1774638109.348859, 'auction_closing_time': 1774714631.0}
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM66057') HTTP/1.1" 204 0
2026-03-27 19:01:49 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-27 19:01:49 [auto1.nl] INFO: Scrape type for GM90003: 2
2026-03-27 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6bd2c73-85a5-5a5c-b1e5-75a149553035 with identifier: GM90003
2026-03-27 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6bd2c73-85a5-5a5c-b1e5-75a149553035 with scrape type 2
2026-03-27 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6bd2c73-85a5-5a5c-b1e5-75a149553035 with scrape type 2
2026-03-27 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6bd2c73-85a5-5a5c-b1e5-75a149553035, identifier: GM90003
2026-03-27 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-27 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543
2026-03-27 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6de1bd27-bd00-57ea-8e40-264c08ec4759 with identifier: UV51543 to the API
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:59:01Z',
 'fuel_type': 'hybrid',
 'id': '6de1bd27-bd00-57ea-8e40-264c08ec4759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV51543',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 184413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-27 19:01:49 [auto1.nl] INFO: Saving data for UV51543: {'auction_closing_time': 1774717141.0, 'created_time': 1774002176.006673, 'last_price_update_time': 1774638109.826501}
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV51543') HTTP/1.1" 204 0
2026-03-27 19:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6bd2c73-85a5-5a5c-b1e5-75a149553035 with identifier: GM90003
2026-03-27 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6bd2c73-85a5-5a5c-b1e5-75a149553035 with identifier: GM90003
2026-03-27 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6bd2c73-85a5-5a5c-b1e5-75a149553035 with identifier: GM90003 to the API
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:54:01Z',
 'fuel_type': 'hybrid',
 'id': 'e6bd2c73-85a5-5a5c-b1e5-75a149553035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM90003',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 189321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2015}
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-27 19:01:50 [auto1.nl] INFO: Saving data for GM90003: {'auction_closing_time': 1774716841.0, 'created_time': 1773302244.099783, 'last_price_update_time': 1774638110.318294}
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GM90003') HTTP/1.1" 204 0
2026-03-27 19:01:50 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH11794%27 HTTP/1.1" 200 None
2026-03-27 19:01:50 [auto1.nl] INFO: Scrape type for VH11794: 1
2026-03-27 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG50012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:50 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ58703%27 HTTP/1.1" 200 None
2026-03-27 19:01:50 [auto1.nl] INFO: Scrape type for LZ58703: 2
2026-03-27 19:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with identifier: LZ58703
2026-03-27 19:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with scrape type 2
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with scrape type 2
2026-03-27 19:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f, identifier: LZ58703
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca33850>
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg saved to cache
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca614d0>
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_e38871e419099d873b76ab971856978f.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e38871e419099d873b76ab971856978f.jpg saved to cache
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca3e250>
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_6ff90774abee93ba02006a4a4d157bac.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6ff90774abee93ba02006a4a4d157bac.jpg saved to cache
2026-03-27 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with identifier: LZ58703
2026-03-27 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with identifier: LZ58703
2026-03-27 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f with identifier: LZ58703 to the API
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:45:11Z',
 'fuel_type': 'petrol',
 'id': '8a7f3a16-ad3f-50b1-a2cc-7c059bab2c0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ58703',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 295748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-19',
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo T JET Dynamic',
 'transmission': 'manual',
 'trim': 'T JET Dynamic',
 'year': 2010}
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ58703%27 HTTP/1.1" 200 None
2026-03-27 19:01:51 [auto1.nl] INFO: Saving data for LZ58703: {'auction_closing_time': 1774716311.0, 'created_time': 1773302568.107429, 'last_price_update_time': 1774638111.016632}
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LZ58703') HTTP/1.1" 204 0
2026-03-27 19:01:51 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-27 19:01:51 [auto1.nl] INFO: Scrape type for MP41726: 2
2026-03-27 19:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-27 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-27 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-27 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 222764fa-5fed-544e-8267-317c3b06ebd9, identifier: MP41726
2026-03-27 19:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-27 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-27 19:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726 to the API
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:11:40Z',
 'fuel_type': 'petrol',
 'id': '222764fa-5fed-544e-8267-317c3b06ebd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP41726',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 181881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2003}
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Saving data for MP41726: {'auction_closing_time': 1774714300.0, 'created_time': 1774465239.115805, 'last_price_update_time': 1774638112.035062}
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP41726') HTTP/1.1" 204 0
2026-03-27 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Scrape type for BM39529: 2
2026-03-27 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b57df448-86ac-53c0-b341-fa74af39731b with identifier: BM39529
2026-03-27 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b57df448-86ac-53c0-b341-fa74af39731b with scrape type 2
2026-03-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b57df448-86ac-53c0-b341-fa74af39731b with scrape type 2
2026-03-27 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b57df448-86ac-53c0-b341-fa74af39731b, identifier: BM39529
2026-03-27 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b57df448-86ac-53c0-b341-fa74af39731b with identifier: BM39529
2026-03-27 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b57df448-86ac-53c0-b341-fa74af39731b with identifier: BM39529
2026-03-27 19:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b57df448-86ac-53c0-b341-fa74af39731b with identifier: BM39529 to the API
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'hybrid',
 'id': 'b57df448-86ac-53c0-b341-fa74af39731b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM39529',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 272069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2015}
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Saving data for BM39529: {'auction_closing_time': 1774714478.0, 'created_time': 1773836894.724532, 'last_price_update_time': 1774638112.511544}
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM39529') HTTP/1.1" 204 0
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Scrape type for BN75332: 1
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Scrape type for ZD81791: 1
2026-03-27 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:52 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-27 19:01:52 [auto1.nl] INFO: Scrape type for CE53949: 2
2026-03-27 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-27 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42cb56-3e90-5069-969d-3a19f0d2cd7d with scrape type 2
2026-03-27 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb42cb56-3e90-5069-969d-3a19f0d2cd7d with scrape type 2
2026-03-27 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eb42cb56-3e90-5069-969d-3a19f0d2cd7d, identifier: CE53949
2026-03-27 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-27 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949
2026-03-27 19:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eb42cb56-3e90-5069-969d-3a19f0d2cd7d with identifier: CE53949 to the API
2026-03-27 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:51Z',
 'fuel_type': 'petrol',
 'id': 'eb42cb56-3e90-5069-969d-3a19f0d2cd7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE53949',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 149803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2016}
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-27 19:01:53 [auto1.nl] INFO: Saving data for CE53949: {'auction_closing_time': 1774713831.0, 'created_time': 1773688435.291099, 'last_price_update_time': 1774638113.537629}
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CE53949') HTTP/1.1" 204 0
2026-03-27 19:01:53 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX83153%27 HTTP/1.1" 200 None
2026-03-27 19:01:53 [auto1.nl] INFO: Scrape type for EX83153: 2
2026-03-27 19:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bd399b6-e344-5aed-ba34-838207711b0a with identifier: EX83153
2026-03-27 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bd399b6-e344-5aed-ba34-838207711b0a with scrape type 2
2026-03-27 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bd399b6-e344-5aed-ba34-838207711b0a with scrape type 2
2026-03-27 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8bd399b6-e344-5aed-ba34-838207711b0a, identifier: EX83153
2026-03-27 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8bd399b6-e344-5aed-ba34-838207711b0a with identifier: EX83153
2026-03-27 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8bd399b6-e344-5aed-ba34-838207711b0a with identifier: EX83153
2026-03-27 19:01:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8bd399b6-e344-5aed-ba34-838207711b0a with identifier: EX83153 to the API
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:49:24Z',
 'fuel_type': 'petrol',
 'id': '8bd399b6-e344-5aed-ba34-838207711b0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX83153',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Grandis',
 'odometer': 236420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-25',
 'seller_name': None,
 'title': 'Mitsubishi Grandis 2.4 Intense',
 'transmission': 'manual',
 'trim': 'Intense',
 'year': 2011}
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX83153%27 HTTP/1.1" 200 None
2026-03-27 19:01:53 [auto1.nl] INFO: Saving data for EX83153: {'auction_closing_time': 1774716564.0, 'created_time': 1773230022.203038, 'last_price_update_time': 1774638113.9728}
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX83153') HTTP/1.1" 204 0
2026-03-27 19:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR22460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:53 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-27 19:01:53 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Scrape type for AL57491: 1
2026-03-27 19:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB03885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT04767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:54 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Scrape type for SG18673: 2
2026-03-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f559aa47-9bb2-560f-ae90-8b062944e1ee, identifier: SG18673
2026-03-27 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-27 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-27 19:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673 to the API
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:19:31Z',
 'fuel_type': 'petrol',
 'id': 'f559aa47-9bb2-560f-ae90-8b062944e1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG18673',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 139178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-08',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2003}
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Saving data for SG18673: {'auction_closing_time': 1774714771.0, 'created_time': 1773774549.425644, 'last_price_update_time': 1774638114.37858}
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG18673') HTTP/1.1" 204 0
2026-03-27 19:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:54 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX59899%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Scrape type for DX59899: 1
2026-03-27 19:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB40041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:54 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:54 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-27 19:01:54 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS72354%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Scrape type for WS72354: 2
2026-03-27 19:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30737af2-04a8-56cc-a256-c80ccd393d61 with identifier: WS72354
2026-03-27 19:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30737af2-04a8-56cc-a256-c80ccd393d61 with scrape type 2
2026-03-27 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30737af2-04a8-56cc-a256-c80ccd393d61 with scrape type 2
2026-03-27 19:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 30737af2-04a8-56cc-a256-c80ccd393d61, identifier: WS72354
2026-03-27 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 30737af2-04a8-56cc-a256-c80ccd393d61 with identifier: WS72354
2026-03-27 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 30737af2-04a8-56cc-a256-c80ccd393d61 with identifier: WS72354
2026-03-27 19:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 30737af2-04a8-56cc-a256-c80ccd393d61 with identifier: WS72354 to the API
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:06:30Z',
 'fuel_type': 'petrol',
 'id': '30737af2-04a8-56cc-a256-c80ccd393d61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS72354',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 26262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2023}
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS72354%27 HTTP/1.1" 200 None
2026-03-27 19:01:54 [auto1.nl] INFO: Saving data for WS72354: {'auction_closing_time': 1774713990.0, 'created_time': 1774465374.154771, 'last_price_update_time': 1774638114.936131}
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WS72354') HTTP/1.1" 204 0
2026-03-27 19:01:54 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-27 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM00486%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Scrape type for WM00486: 1
2026-03-27 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Scrape type for FA84913: 2
2026-03-27 19:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-27 19:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e654c2bc-444b-5afc-859c-22492f4348ae with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e654c2bc-444b-5afc-859c-22492f4348ae with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e654c2bc-444b-5afc-859c-22492f4348ae, identifier: FA84913
2026-03-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913
2026-03-27 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e654c2bc-444b-5afc-859c-22492f4348ae with identifier: FA84913 to the API
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:15:26Z',
 'fuel_type': 'petrol',
 'id': 'e654c2bc-444b-5afc-859c-22492f4348ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA84913',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 144149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2016}
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Saving data for FA84913: {'auction_closing_time': 1774714526.0, 'created_time': 1773342321.860622, 'last_price_update_time': 1774638115.386765}
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA84913') HTTP/1.1" 204 0
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM72619%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Scrape type for YM72619: 2
2026-03-27 19:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6a8a791-845a-5df4-9914-be243b8d15cf with identifier: YM72619
2026-03-27 19:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6a8a791-845a-5df4-9914-be243b8d15cf with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6a8a791-845a-5df4-9914-be243b8d15cf with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c6a8a791-845a-5df4-9914-be243b8d15cf, identifier: YM72619
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Scrape type for JP82620: 1
2026-03-27 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c6a8a791-845a-5df4-9914-be243b8d15cf with identifier: YM72619
2026-03-27 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c6a8a791-845a-5df4-9914-be243b8d15cf with identifier: YM72619
2026-03-27 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c6a8a791-845a-5df4-9914-be243b8d15cf with identifier: YM72619 to the API
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'petrol',
 'id': 'c6a8a791-845a-5df4-9914-be243b8d15cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM72619',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 80466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2021}
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM72619%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Saving data for YM72619: {'auction_closing_time': 1774714956.0, 'created_time': 1773133845.949188, 'last_price_update_time': 1774638115.860557}
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YM72619') HTTP/1.1" 204 0
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-27 19:01:55 [auto1.nl] INFO: Scrape type for MY24327: 2
2026-03-27 19:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-27 19:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a054939f-0e95-5617-ab4b-575626c6e28e with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a054939f-0e95-5617-ab4b-575626c6e28e with scrape type 2
2026-03-27 19:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a054939f-0e95-5617-ab4b-575626c6e28e, identifier: MY24327
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-27 19:01:55 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Scrape type for JB49049: 1
2026-03-27 19:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-27 19:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327
2026-03-27 19:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a054939f-0e95-5617-ab4b-575626c6e28e with identifier: MY24327 to the API
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:56Z',
 'fuel_type': 'petrol',
 'id': 'a054939f-0e95-5617-ab4b-575626c6e28e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY24327',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 280833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-10',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Saving data for MY24327: {'auction_closing_time': 1774714976.0, 'created_time': 1773343192.548245, 'last_price_update_time': 1774638116.299561}
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY24327') HTTP/1.1" 204 0
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL08717%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Scrape type for EL08717: 2
2026-03-27 19:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with identifier: EL08717
2026-03-27 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with scrape type 2
2026-03-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with scrape type 2
2026-03-27 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6b6b50fa-36a8-5426-9aa2-c5123f25b481, identifier: EL08717
2026-03-27 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VH11794/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Scrape type for RM92541: 1
2026-03-27 19:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with identifier: EL08717
2026-03-27 19:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with identifier: EL08717
2026-03-27 19:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6b6b50fa-36a8-5426-9aa2-c5123f25b481 with identifier: EL08717 to the API
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:25:35Z',
 'fuel_type': 'petrol',
 'id': '6b6b50fa-36a8-5426-9aa2-c5123f25b481',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL08717',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 311516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Volvo V70 2.0 T Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2011}
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL08717%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Saving data for EL08717: {'auction_closing_time': 1774715135.0, 'created_time': 1773232206.238851, 'last_price_update_time': 1774638116.758122}
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL08717') HTTP/1.1" 204 0
2026-03-27 19:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_642a95c52ba540ca06cf6417a07e29d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Scrape type for FD20387: 2
2026-03-27 19:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-27 19:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78d2d19f-a50a-5311-89f9-369e8bb29971 with scrape type 2
2026-03-27 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78d2d19f-a50a-5311-89f9-369e8bb29971 with scrape type 2
2026-03-27 19:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78d2d19f-a50a-5311-89f9-369e8bb29971, identifier: FD20387
2026-03-27 19:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:01:56 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-27 19:01:56 [auto1.nl] INFO: Scrape type for XV86348: 1
2026-03-27 19:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-27 19:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387
2026-03-27 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78d2d19f-a50a-5311-89f9-369e8bb29971 with identifier: FD20387 to the API
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:08:58Z',
 'fuel_type': 'petrol',
 'id': '78d2d19f-a50a-5311-89f9-369e8bb29971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD20387',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 197943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-29',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-27 19:01:57 [auto1.nl] INFO: Saving data for FD20387: {'auction_closing_time': 1774714138.0, 'created_time': 1773923580.869206, 'last_price_update_time': 1774638117.302379}
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD20387') HTTP/1.1" 204 0
2026-03-27 19:01:57 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-27 19:01:57 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-27 19:01:57 [auto1.nl] INFO: Scrape type for HF10176: 2
2026-03-27 19:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-27 19:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-27 19:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c454cb49-c890-5f14-bd4c-482023415706, identifier: HF10176
2026-03-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG50012> (referer: https://www.auto1.com/v1/car-details-view/GG50012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD81791/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN75332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:57 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL79871%27 HTTP/1.1" 200 None
2026-03-27 19:01:57 [auto1.nl] INFO: Scrape type for NL79871: 2
2026-03-27 19:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df48ba3a-35d9-5fc5-8761-d0d6af942d43 with identifier: NL79871
2026-03-27 19:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df48ba3a-35d9-5fc5-8761-d0d6af942d43 with scrape type 2
2026-03-27 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df48ba3a-35d9-5fc5-8761-d0d6af942d43 with scrape type 2
2026-03-27 19:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: df48ba3a-35d9-5fc5-8761-d0d6af942d43, identifier: NL79871
2026-03-27 19:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-27 19:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-27 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176 to the API
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:05:14Z',
 'fuel_type': 'petrol',
 'id': 'c454cb49-c890-5f14-bd4c-482023415706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF10176',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 27697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seller_name': None,
 'title': 'BMW 4er 420i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-27 19:01:57 [auto1.nl] INFO: Saving data for HF10176: {'auction_closing_time': 1774713914.0, 'created_time': 1774465377.781767, 'last_price_update_time': 1774638117.837073}
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HF10176') HTTP/1.1" 204 0
2026-03-27 19:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: df48ba3a-35d9-5fc5-8761-d0d6af942d43 with identifier: NL79871
2026-03-27 19:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: df48ba3a-35d9-5fc5-8761-d0d6af942d43 with identifier: NL79871
2026-03-27 19:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: df48ba3a-35d9-5fc5-8761-d0d6af942d43 with identifier: NL79871 to the API
2026-03-27 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:14:45Z',
 'fuel_type': 'petrol',
 'id': 'df48ba3a-35d9-5fc5-8761-d0d6af942d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL79871',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 48646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-20',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL79871%27 HTTP/1.1" 200 None
2026-03-27 19:01:58 [auto1.nl] INFO: Saving data for NL79871: {'auction_closing_time': 1774714485.0, 'created_time': 1774465248.80451, 'last_price_update_time': 1774638118.158109}
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL79871') HTTP/1.1" 204 0
2026-03-27 19:01:58 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-27 19:01:58 [auto1.nl] INFO: Scrape type for KB01407: 1
2026-03-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL57491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca24f90>
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_642a95c52ba540ca06cf6417a07e29d2.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_642a95c52ba540ca06cf6417a07e29d2.jpg saved to cache
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff66350>
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgce%252F13%252Fce13a84fc72ee4bbfeda362b39e7c232%252Fpa%252FWV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg') HTTP/1.1" 204 0
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg saved to cache
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a826134e-57fc-575d-bb55-342bee867644
2026-03-27 19:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a826134e-57fc-575d-bb55-342bee867644, skipping ID generation
2026-03-27 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a826134e-57fc-575d-bb55-342bee867644 with scrape type 1
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a826134e-57fc-575d-bb55-342bee867644 sending to next pipeline
2026-03-27 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a826134e-57fc-575d-bb55-342bee867644, identifier: WV84251
2026-03-27 19:01:58 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-27 19:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a826134e-57fc-575d-bb55-342bee867644 with identifier: WV84251
2026-03-27 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a826134e-57fc-575d-bb55-342bee867644 with identifier: WV84251
2026-03-27 19:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a826134e-57fc-575d-bb55-342bee867644 with identifier: WV84251 to the API
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:00Z',
 'fuel_type': 'hybrid',
 'id': 'a826134e-57fc-575d-bb55-342bee867644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '03ZVZ9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV84251',
 'listing': 'auction',
 'location': 'NL, Den Bosch',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 246243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6823128e7603c3cfed4c95a1d6614f7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_08053da3943c822f3de73dfd9700c655.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_dae40c96f5b8924b5178ef42a5e77698.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e422db94d252117d8ab5a27c1470fa8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_7bf66f959e19870317aa476365af6edd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_6ff90774abee93ba02006a4a4d157bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2293597,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_d381634fb2dd3ae9e79f7ff8fe7d7aa2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_f6d13cadaeaa2aa87d29a83cc80b9680.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_e38871e419099d873b76ab971856978f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a826134e-57fc-575d-bb55-342bee867644/a826134e-57fc-575d-bb55-342bee867644_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2288325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgce/13/ce13a84fc72ee4bbfeda362b39e7c232/pa/WV84251_642a95c52ba540ca06cf6417a07e29d2.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.4 TSI Hybrid Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV84251%27 HTTP/1.1" 200 None
2026-03-27 19:01:58 [auto1.nl] INFO: Saving data for WV84251: {'created_time': 1774638118.875184, 'last_price_update_time': 1774638118.875195, 'auction_closing_time': 1774715280.0}
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV84251') HTTP/1.1" 204 0
2026-03-27 19:01:58 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB67844%27 HTTP/1.1" 200 None
2026-03-27 19:01:58 [auto1.nl] INFO: Scrape type for NB67844: 2
2026-03-27 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13647d1-d96b-5081-bd86-8e802193b6b9 with identifier: NB67844
2026-03-27 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13647d1-d96b-5081-bd86-8e802193b6b9 with scrape type 2
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13647d1-d96b-5081-bd86-8e802193b6b9 with scrape type 2
2026-03-27 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d13647d1-d96b-5081-bd86-8e802193b6b9, identifier: NB67844
2026-03-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT04767> (referer: https://www.auto1.com/v1/car-details-view/CT04767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB03885> (referer: https://www.auto1.com/v1/car-details-view/HB03885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 190d7411-3c76-5b09-953f-c91418d9d400 with identifier: GG50012
2026-03-27 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 190d7411-3c76-5b09-953f-c91418d9d400 with scrape type 1
2026-03-27 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 190d7411-3c76-5b09-953f-c91418d9d400
2026-03-27 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_6353d1d9dd86d5b726c40a1d35ba00fe.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_6353d1d9dd86d5b726c40a1d35ba00fe.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_c4ba4151139ecb3e4be2b058dd5096c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_c4ba4151139ecb3e4be2b058dd5096c2.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_5640fd03626d39b251a4f9c16fdc5808.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_5640fd03626d39b251a4f9c16fdc5808.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_8662879e5526a2c4fec7a1d9fcad3add.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8662879e5526a2c4fec7a1d9fcad3add.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_8dcee5ec372fa211dfaa6957c00bf3cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8dcee5ec372fa211dfaa6957c00bf3cd.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_bb79abd17ef7dac6291783da37891c98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_bb79abd17ef7dac6291783da37891c98.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_57cc98dbcef2bbf073b08f6e251a1328.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_57cc98dbcef2bbf073b08f6e251a1328.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_517ebd0d02d717b574f46141418fd94b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_517ebd0d02d717b574f46141418fd94b.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_2e487d7d785211c65d85d80f822d81c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_2e487d7d785211c65d85d80f822d81c0.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Fb4%252Fa9b4c177cb32a1b9c0764ce5995d8760%252Fpa%252FGG50012_b39c97053f07791f722315447ef1cf2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_b39c97053f07791f722315447ef1cf2a.jpg already downloaded
2026-03-27 19:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 190d7411-3c76-5b09-953f-c91418d9d400, identifier: GG50012
2026-03-27 19:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d13647d1-d96b-5081-bd86-8e802193b6b9 with identifier: NB67844
2026-03-27 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d13647d1-d96b-5081-bd86-8e802193b6b9 with identifier: NB67844
2026-03-27 19:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d13647d1-d96b-5081-bd86-8e802193b6b9 with identifier: NB67844 to the API
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'petrol',
 'id': 'd13647d1-d96b-5081-bd86-8e802193b6b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB67844',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 158250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-18',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB67844%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [auto1.nl] INFO: Saving data for NB67844: {'auction_closing_time': 1774714494.0, 'created_time': 1773135336.157919, 'last_price_update_time': 1774638119.529534}
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NB67844') HTTP/1.1" 204 0
2026-03-27 19:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 190d7411-3c76-5b09-953f-c91418d9d400 with identifier: GG50012
2026-03-27 19:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 190d7411-3c76-5b09-953f-c91418d9d400 with identifier: GG50012
2026-03-27 19:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 190d7411-3c76-5b09-953f-c91418d9d400 with identifier: GG50012 to the API
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GG50012>
{'auction_title': '',
 'c_o_2_emission_value': 262,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:35:57Z',
 'fuel_type': 'petrol',
 'id': '190d7411-3c76-5b09-953f-c91418d9d400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '97JDG4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG50012',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 186142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_6353d1d9dd86d5b726c40a1d35ba00fe.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_c4ba4151139ecb3e4be2b058dd5096c2.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_5640fd03626d39b251a4f9c16fdc5808.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8662879e5526a2c4fec7a1d9fcad3add.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8dcee5ec372fa211dfaa6957c00bf3cd.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_bb79abd17ef7dac6291783da37891c98.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_57cc98dbcef2bbf073b08f6e251a1328.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_517ebd0d02d717b574f46141418fd94b.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_2e487d7d785211c65d85d80f822d81c0.jpg',
                'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_b39c97053f07791f722315447ef1cf2a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_6353d1d9dd86d5b726c40a1d35ba00fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_c4ba4151139ecb3e4be2b058dd5096c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_5640fd03626d39b251a4f9c16fdc5808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8662879e5526a2c4fec7a1d9fcad3add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_8dcee5ec372fa211dfaa6957c00bf3cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_bb79abd17ef7dac6291783da37891c98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_57cc98dbcef2bbf073b08f6e251a1328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_517ebd0d02d717b574f46141418fd94b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_2e487d7d785211c65d85d80f822d81c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_190d7411-3c76-5b09-953f-c91418d9d400/190d7411-3c76-5b09-953f-c91418d9d400_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/b4/a9b4c177cb32a1b9c0764ce5995d8760/pa/GG50012_b39c97053f07791f722315447ef1cf2a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW X6 xDrive 35i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [auto1.nl] INFO: Saving data for GG50012: {'created_time': 1774638119.828885, 'last_price_update_time': 1774638119.828896, 'auction_closing_time': 1774715757.0}
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG50012') HTTP/1.1" 204 0
2026-03-27 19:01:59 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY02674%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [auto1.nl] INFO: Scrape type for TY02674: 1
2026-03-27 19:01:59 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 916 | hits on page: 40
2026-03-27 19:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c946b438-a855-5a71-830f-c7de17443b0b with identifier: CT04767
2026-03-27 19:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c946b438-a855-5a71-830f-c7de17443b0b with scrape type 1
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item c946b438-a855-5a71-830f-c7de17443b0b
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fe2%252Fd7e2c339d99aff134c252567499bb4a2%252Fpa%252FCT04767_9dcf02f3de4ee03a355f248a5b785e26.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9dcf02f3de4ee03a355f248a5b785e26.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fe2%252Fd7e2c339d99aff134c252567499bb4a2%252Fpa%252FCT04767_eba046777dc3d30e8a267c490390cfe0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_eba046777dc3d30e8a267c490390cfe0.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fe2%252Fd7e2c339d99aff134c252567499bb4a2%252Fpa%252FCT04767_9bc80e63addea6b0c87a6a5b92f3db42.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9bc80e63addea6b0c87a6a5b92f3db42.jpg already downloaded
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd7%252Fe2%252Fd7e2c339d99aff134c252567499bb4a2%252Fpa%252FCT04767_2a584c11b663483ee606611823b4f465.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_2a584c11b663483ee606611823b4f465.jpg already downloaded
2026-03-27 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c946b438-a855-5a71-830f-c7de17443b0b, identifier: CT04767
2026-03-27 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-27 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc4ed060-3569-5d5a-b837-710f96c36a93 with scrape type 1
2026-03-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_061ad63f776500ec0f48d24c59b9fa13.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_061ad63f776500ec0f48d24c59b9fa13.jpg not downloaded yet
2026-03-27 19:02:00 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [auto1.nl] INFO: Scrape type for SD85786: 1
2026-03-27 19:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c946b438-a855-5a71-830f-c7de17443b0b with identifier: CT04767
2026-03-27 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c946b438-a855-5a71-830f-c7de17443b0b with identifier: CT04767
2026-03-27 19:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c946b438-a855-5a71-830f-c7de17443b0b with identifier: CT04767 to the API
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CT04767>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 3',
 'engine': '1.1L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:03:42Z',
 'fuel_type': 'petrol',
 'id': 'c946b438-a855-5a71-830f-c7de17443b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '20GKSN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT04767',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 183118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9dcf02f3de4ee03a355f248a5b785e26.jpg',
                'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_eba046777dc3d30e8a267c490390cfe0.jpg',
                'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9bc80e63addea6b0c87a6a5b92f3db42.jpg',
                'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_2a584c11b663483ee606611823b4f465.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c946b438-a855-5a71-830f-c7de17443b0b/c946b438-a855-5a71-830f-c7de17443b0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9dcf02f3de4ee03a355f248a5b785e26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c946b438-a855-5a71-830f-c7de17443b0b/c946b438-a855-5a71-830f-c7de17443b0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_eba046777dc3d30e8a267c490390cfe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c946b438-a855-5a71-830f-c7de17443b0b/c946b438-a855-5a71-830f-c7de17443b0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_9bc80e63addea6b0c87a6a5b92f3db42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c946b438-a855-5a71-830f-c7de17443b0b/c946b438-a855-5a71-830f-c7de17443b0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd7/e2/d7e2c339d99aff134c252567499bb4a2/pa/CT04767_2a584c11b663483ee606611823b4f465.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-01-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2001}
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT04767%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [auto1.nl] INFO: Saving data for CT04767: {'created_time': 1774638120.431979, 'last_price_update_time': 1774638120.43199, 'auction_closing_time': 1774713822.0}
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT04767') HTTP/1.1" 204 0
2026-03-27 19:02:00 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [auto1.nl] INFO: Scrape type for VU71978: 1
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_70603d656aac994c9b2a435765a71fb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_70603d656aac994c9b2a435765a71fb0.jpg not downloaded yet
2026-03-27 19:02:00 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-27 19:02:00 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-27 19:02:00 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [auto1.nl] INFO: Scrape type for HP30662: 2
2026-03-27 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with identifier: HP30662
2026-03-27 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with scrape type 2
2026-03-27 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with scrape type 2
2026-03-27 19:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 78bcdfb9-2b97-57bb-a74a-fa8775416ea2, identifier: HP30662
2026-03-27 19:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with identifier: HP30662
2026-03-27 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with identifier: HP30662
2026-03-27 19:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 78bcdfb9-2b97-57bb-a74a-fa8775416ea2 with identifier: HP30662 to the API
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:19:55Z',
 'fuel_type': 'petrol',
 'id': '78bcdfb9-2b97-57bb-a74a-fa8775416ea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP30662',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 322043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-08',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-27 19:02:00 [auto1.nl] INFO: Saving data for HP30662: {'auction_closing_time': 1774714795.0, 'created_time': 1773229214.153939, 'last_price_update_time': 1774638120.899289}
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HP30662') HTTP/1.1" 204 0
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Scrape type for ZR26013: 2
2026-03-27 19:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-27 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ffd493-8801-52f6-a59a-e0398ce28620 with scrape type 2
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ffd493-8801-52f6-a59a-e0398ce28620 with scrape type 2
2026-03-27 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 25ffd493-8801-52f6-a59a-e0398ce28620, identifier: ZR26013
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg not downloaded yet
2026-03-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR22460> (referer: https://www.auto1.com/v1/car-details-view/GR22460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ83148%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Scrape type for MZ83148: 2
2026-03-27 19:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9985dc-44dc-51e5-a5bc-7428e6a581f3 with identifier: MZ83148
2026-03-27 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9985dc-44dc-51e5-a5bc-7428e6a581f3 with scrape type 2
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de9985dc-44dc-51e5-a5bc-7428e6a581f3 with scrape type 2
2026-03-27 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de9985dc-44dc-51e5-a5bc-7428e6a581f3, identifier: MZ83148
2026-03-27 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-27 19:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013
2026-03-27 19:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 25ffd493-8801-52f6-a59a-e0398ce28620 with identifier: ZR26013 to the API
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:54Z',
 'fuel_type': 'diesel',
 'id': '25ffd493-8801-52f6-a59a-e0398ce28620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR26013',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 229109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-20',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Saving data for ZR26013: {'auction_closing_time': 1774714374.0, 'created_time': 1773921684.938674, 'last_price_update_time': 1774638121.505579}
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZR26013') HTTP/1.1" 204 0
2026-03-27 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de9985dc-44dc-51e5-a5bc-7428e6a581f3 with identifier: MZ83148
2026-03-27 19:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de9985dc-44dc-51e5-a5bc-7428e6a581f3 with identifier: MZ83148
2026-03-27 19:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de9985dc-44dc-51e5-a5bc-7428e6a581f3 with identifier: MZ83148 to the API
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:29:40Z',
 'fuel_type': 'petrol',
 'id': 'de9985dc-44dc-51e5-a5bc-7428e6a581f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83148',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 137646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Classic 2WD',
 'transmission': 'manual',
 'trim': 'Classic 2WD',
 'year': 2019}
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ83148%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Saving data for MZ83148: {'auction_closing_time': 1774715380.0, 'created_time': 1773132193.756257, 'last_price_update_time': 1774638121.792123}
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MZ83148') HTTP/1.1" 204 0
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Scrape type for NF42307: 1
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_3a0e00b2033794f953d824e543b71ad8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_3a0e00b2033794f953d824e543b71ad8.jpg not downloaded yet
2026-03-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_061ad63f776500ec0f48d24c59b9fa13.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF88410%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Scrape type for TF88410: 1
2026-03-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX59899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JP82620/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-27 19:02:01 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV95890%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [auto1.nl] INFO: Scrape type for DV95890: 1
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg not downloaded yet
2026-03-27 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB40041> (referer: https://www.auto1.com/v1/car-details-view/WB40041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-27 19:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 1
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_8242544d90c0c00892cd8813b377636d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_8242544d90c0c00892cd8813b377636d.jpg already downloaded
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_b454fde5cfe5d6dc30ff151397d81d69.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b454fde5cfe5d6dc30ff151397d81d69.jpg already downloaded
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_b8f7b9ac1ea9ff19c53aaa08cde1d574.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b8f7b9ac1ea9ff19c53aaa08cde1d574.jpg already downloaded
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_308bdba1b02384467f351371c15d53a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_308bdba1b02384467f351371c15d53a0.jpg already downloaded
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_97f6573dd099d9425e04a6798ee27b52.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_97f6573dd099d9425e04a6798ee27b52.jpg already downloaded
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252F3b%252F9f3baedd980b5e0e6caa3b7a817982b0%252Fpa%252FGR22460_7298199257c6cec2161ac981d3f341ca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_7298199257c6cec2161ac981d3f341ca.jpg already downloaded
2026-03-27 19:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f, identifier: GR22460
2026-03-27 19:02:02 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK64597%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [auto1.nl] INFO: Scrape type for YK64597: 2
2026-03-27 19:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fed9bed-18ce-5a5f-b651-83889f160fc6 with identifier: YK64597
2026-03-27 19:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fed9bed-18ce-5a5f-b651-83889f160fc6 with scrape type 2
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fed9bed-18ce-5a5f-b651-83889f160fc6 with scrape type 2
2026-03-27 19:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2fed9bed-18ce-5a5f-b651-83889f160fc6, identifier: YK64597
2026-03-27 19:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB49049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV86348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-27 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-27 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460 to the API
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GR22460>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:30:34Z',
 'fuel_type': 'petrol',
 'id': 'fe0374b9-a0e1-5263-a0c2-c8448f3fb80f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '25jdv4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR22460',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 226203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_8242544d90c0c00892cd8813b377636d.jpg',
                'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b454fde5cfe5d6dc30ff151397d81d69.jpg',
                'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b8f7b9ac1ea9ff19c53aaa08cde1d574.jpg',
                'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_308bdba1b02384467f351371c15d53a0.jpg',
                'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_97f6573dd099d9425e04a6798ee27b52.jpg',
                'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_7298199257c6cec2161ac981d3f341ca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_8242544d90c0c00892cd8813b377636d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b454fde5cfe5d6dc30ff151397d81d69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_b8f7b9ac1ea9ff19c53aaa08cde1d574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_308bdba1b02384467f351371c15d53a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_97f6573dd099d9425e04a6798ee27b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fe0374b9-a0e1-5263-a0c2-c8448f3fb80f/fe0374b9-a0e1-5263-a0c2-c8448f3fb80f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/3b/9f3baedd980b5e0e6caa3b7a817982b0/pa/GR22460_7298199257c6cec2161ac981d3f341ca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2009}
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [auto1.nl] INFO: Saving data for GR22460: {'created_time': 1774638122.518145, 'last_price_update_time': 1774638122.518155, 'auction_closing_time': 1774715434.0}
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR22460') HTTP/1.1" 204 0
2026-03-27 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2fed9bed-18ce-5a5f-b651-83889f160fc6 with identifier: YK64597
2026-03-27 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2fed9bed-18ce-5a5f-b651-83889f160fc6 with identifier: YK64597
2026-03-27 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2fed9bed-18ce-5a5f-b651-83889f160fc6 with identifier: YK64597 to the API
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:14:42Z',
 'fuel_type': 'petrol',
 'id': '2fed9bed-18ce-5a5f-b651-83889f160fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK64597',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 222024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-16',
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK64597%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [auto1.nl] INFO: Saving data for YK64597: {'auction_closing_time': 1774714482.0, 'created_time': 1773132855.660132, 'last_price_update_time': 1774638122.870793}
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YK64597') HTTP/1.1" 204 0
2026-03-27 19:02:02 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-27 19:02:02 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-27 19:02:02 [auto1.nl] INFO: Scrape type for BN97277: 2
2026-03-27 19:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-27 19:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b49c810-01bc-5d31-be02-25a52723b432 with scrape type 2
2026-03-27 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b49c810-01bc-5d31-be02-25a52723b432 with scrape type 2
2026-03-27 19:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b49c810-01bc-5d31-be02-25a52723b432, identifier: BN97277
2026-03-27 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_ee3307919ff71f7957fce93d0edf58c8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_ee3307919ff71f7957fce93d0edf58c8.jpg not downloaded yet
2026-03-27 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:03 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-27 19:02:03 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-27 19:02:03 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [auto1.nl] INFO: Scrape type for JN86544: 1
2026-03-27 19:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-27 19:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277
2026-03-27 19:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b49c810-01bc-5d31-be02-25a52723b432 with identifier: BN97277 to the API
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:08:58Z',
 'fuel_type': 'petrol',
 'id': '2b49c810-01bc-5d31-be02-25a52723b432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN97277',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 170060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [auto1.nl] INFO: Saving data for BN97277: {'auction_closing_time': 1774714138.0, 'created_time': 1773489664.448831, 'last_price_update_time': 1774638123.575346}
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN97277') HTTP/1.1" 204 0
2026-03-27 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM92541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca96a10>
2026-03-27 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_061ad63f776500ec0f48d24c59b9fa13.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_061ad63f776500ec0f48d24c59b9fa13.jpg saved to cache
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e47b09-acb0-57dd-9ee6-c70053bc24db with identifier: WB40041
2026-03-27 19:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e47b09-acb0-57dd-9ee6-c70053bc24db with scrape type 1
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 83e47b09-acb0-57dd-9ee6-c70053bc24db
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_6d09a345cb340f98ec552c2f0e58ac90.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6d09a345cb340f98ec552c2f0e58ac90.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_869f793457a62938353ff61bb438d329.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_869f793457a62938353ff61bb438d329.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_3bd8c6c3178a6b08997840ce9d844af9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3bd8c6c3178a6b08997840ce9d844af9.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_7d5a376439363aa0a87df889a4f92bfb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_7d5a376439363aa0a87df889a4f92bfb.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_267982e4dadff71970ad9176112468e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_267982e4dadff71970ad9176112468e2.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_9608f1314a31d50350739df091656a68.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_9608f1314a31d50350739df091656a68.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_3fdc9dabd54948bb2938bf94c1b99598.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3fdc9dabd54948bb2938bf94c1b99598.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_06df87b94847c017c1ae5061a8ed7617.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_06df87b94847c017c1ae5061a8ed7617.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_71e5a23603d7102a7e0f07b7cf00c2ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_71e5a23603d7102a7e0f07b7cf00c2ea.jpg already downloaded
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F5e%252F345e5925b60541e1904df8ca0ee9c759%252Fpa%252FWB40041_6bef3adaa7b557ec155538f3c47afa99.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6bef3adaa7b557ec155538f3c47afa99.jpg already downloaded
2026-03-27 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83e47b09-acb0-57dd-9ee6-c70053bc24db, identifier: WB40041
2026-03-27 19:02:04 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG40185%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [auto1.nl] INFO: Scrape type for FG40185: 1
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg not downloaded yet
2026-03-27 19:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83e47b09-acb0-57dd-9ee6-c70053bc24db with identifier: WB40041
2026-03-27 19:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83e47b09-acb0-57dd-9ee6-c70053bc24db with identifier: WB40041
2026-03-27 19:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83e47b09-acb0-57dd-9ee6-c70053bc24db with identifier: WB40041 to the API
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WB40041>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:34:41Z',
 'fuel_type': 'petrol',
 'id': '83e47b09-acb0-57dd-9ee6-c70053bc24db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB40041',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 36938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6d09a345cb340f98ec552c2f0e58ac90.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_869f793457a62938353ff61bb438d329.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3bd8c6c3178a6b08997840ce9d844af9.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_7d5a376439363aa0a87df889a4f92bfb.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_267982e4dadff71970ad9176112468e2.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_9608f1314a31d50350739df091656a68.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3fdc9dabd54948bb2938bf94c1b99598.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_06df87b94847c017c1ae5061a8ed7617.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_71e5a23603d7102a7e0f07b7cf00c2ea.jpg',
                'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6bef3adaa7b557ec155538f3c47afa99.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6d09a345cb340f98ec552c2f0e58ac90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_869f793457a62938353ff61bb438d329.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3bd8c6c3178a6b08997840ce9d844af9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_7d5a376439363aa0a87df889a4f92bfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_267982e4dadff71970ad9176112468e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_9608f1314a31d50350739df091656a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_3fdc9dabd54948bb2938bf94c1b99598.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_06df87b94847c017c1ae5061a8ed7617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_71e5a23603d7102a7e0f07b7cf00c2ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83e47b09-acb0-57dd-9ee6-c70053bc24db/83e47b09-acb0-57dd-9ee6-c70053bc24db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/5e/345e5925b60541e1904df8ca0ee9c759/pa/WB40041_6bef3adaa7b557ec155538f3c47afa99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB40041%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [auto1.nl] INFO: Saving data for WB40041: {'created_time': 1774638124.385804, 'last_price_update_time': 1774638124.385814, 'auction_closing_time': 1774715681.0}
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WB40041') HTTP/1.1" 204 0
2026-03-27 19:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:04 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-27 19:02:04 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [auto1.nl] INFO: Scrape type for SM09418: 2
2026-03-27 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with identifier: SM09418
2026-03-27 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with scrape type 2
2026-03-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with scrape type 2
2026-03-27 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 66c1c4f9-6eec-5f08-baaa-44fda111fa6c, identifier: SM09418
2026-03-27 19:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with identifier: SM09418
2026-03-27 19:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with identifier: SM09418
2026-03-27 19:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 66c1c4f9-6eec-5f08-baaa-44fda111fa6c with identifier: SM09418 to the API
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:03:59Z',
 'fuel_type': 'petrol',
 'id': '66c1c4f9-6eec-5f08-baaa-44fda111fa6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09418',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 149438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Opel Agila 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [auto1.nl] INFO: Saving data for SM09418: {'auction_closing_time': 1774713839.0, 'created_time': 1773229216.07823, 'last_price_update_time': 1774638124.87785}
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM09418') HTTP/1.1" 204 0
2026-03-27 19:02:04 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-27 19:02:04 [auto1.nl] INFO: Scrape type for EG87315: 2
2026-03-27 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-27 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ece01be2-e1ea-577d-bce5-1ab157c812d5 with scrape type 2
2026-03-27 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ece01be2-e1ea-577d-bce5-1ab157c812d5 with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ece01be2-e1ea-577d-bce5-1ab157c812d5, identifier: EG87315
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_61021ed2062857709f39dcec874e9f6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_61021ed2062857709f39dcec874e9f6d.jpg not downloaded yet
2026-03-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL21960%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [auto1.nl] INFO: Scrape type for TL21960: 2
2026-03-27 19:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 143c7cd3-51dc-5c1e-8a44-b470467c941b with identifier: TL21960
2026-03-27 19:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 143c7cd3-51dc-5c1e-8a44-b470467c941b with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 143c7cd3-51dc-5c1e-8a44-b470467c941b with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 143c7cd3-51dc-5c1e-8a44-b470467c941b, identifier: TL21960
2026-03-27 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-27 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315
2026-03-27 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ece01be2-e1ea-577d-bce5-1ab157c812d5 with identifier: EG87315 to the API
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:08:05Z',
 'fuel_type': 'petrol',
 'id': 'ece01be2-e1ea-577d-bce5-1ab157c812d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG87315',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 205989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-06',
 'seller_name': None,
 'title': 'Renault Espace 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2015}
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [auto1.nl] INFO: Saving data for EG87315: {'auction_closing_time': 1774714085.0, 'created_time': 1773924766.464107, 'last_price_update_time': 1774638125.438538}
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG87315') HTTP/1.1" 204 0
2026-03-27 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 143c7cd3-51dc-5c1e-8a44-b470467c941b with identifier: TL21960
2026-03-27 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 143c7cd3-51dc-5c1e-8a44-b470467c941b with identifier: TL21960
2026-03-27 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 143c7cd3-51dc-5c1e-8a44-b470467c941b with identifier: TL21960 to the API
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:34Z',
 'fuel_type': 'diesel',
 'id': '143c7cd3-51dc-5c1e-8a44-b470467c941b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL21960',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 199588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 R-Design Kinetic',
 'transmission': 'manual',
 'trim': 'R-Design Kinetic',
 'year': 2015}
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL21960%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [auto1.nl] INFO: Saving data for TL21960: {'auction_closing_time': 1774714594.0, 'created_time': 1773131865.681031, 'last_price_update_time': 1774638125.746663}
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TL21960') HTTP/1.1" 204 0
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ83628%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [auto1.nl] INFO: Scrape type for GZ83628: 2
2026-03-27 19:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3480ecaa-79e4-514f-bac1-f507f10eace7 with identifier: GZ83628
2026-03-27 19:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3480ecaa-79e4-514f-bac1-f507f10eace7 with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3480ecaa-79e4-514f-bac1-f507f10eace7 with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3480ecaa-79e4-514f-bac1-f507f10eace7, identifier: GZ83628
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_39f3bf739cec027e726857605f2628a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_39f3bf739cec027e726857605f2628a5.jpg not downloaded yet
2026-03-27 19:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe59dd0>
2026-03-27 19:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg saved to cache
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_ee3307919ff71f7957fce93d0edf58c8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-27 19:02:05 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV90025%27 HTTP/1.1" 200 None
2026-03-27 19:02:05 [auto1.nl] INFO: Scrape type for MV90025: 2
2026-03-27 19:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with identifier: MV90025
2026-03-27 19:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with scrape type 2
2026-03-27 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with scrape type 2
2026-03-27 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 63f8ce4b-28f7-5d12-8895-cd4d995bbf05, identifier: MV90025
2026-03-27 19:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3480ecaa-79e4-514f-bac1-f507f10eace7 with identifier: GZ83628
2026-03-27 19:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3480ecaa-79e4-514f-bac1-f507f10eace7 with identifier: GZ83628
2026-03-27 19:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3480ecaa-79e4-514f-bac1-f507f10eace7 with identifier: GZ83628 to the API
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'diesel',
 'id': '3480ecaa-79e4-514f-bac1-f507f10eace7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ83628',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 304549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-20',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ83628%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [auto1.nl] INFO: Saving data for GZ83628: {'auction_closing_time': 1774716795.0, 'created_time': 1774465407.286091, 'last_price_update_time': 1774638126.293146}
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ83628') HTTP/1.1" 204 0
2026-03-27 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VH11794> (referer: https://www.auto1.com/v1/car-details-view/VH11794/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with identifier: MV90025
2026-03-27 19:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with identifier: MV90025
2026-03-27 19:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 63f8ce4b-28f7-5d12-8895-cd4d995bbf05 with identifier: MV90025 to the API
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:56:52Z',
 'fuel_type': 'diesel',
 'id': '63f8ce4b-28f7-5d12-8895-cd4d995bbf05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV90025',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 94657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2018}
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV90025%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [auto1.nl] INFO: Saving data for MV90025: {'auction_closing_time': 1774717012.0, 'created_time': 1773132073.7818, 'last_price_update_time': 1774638126.670445}
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV90025') HTTP/1.1" 204 0
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [auto1.nl] INFO: Scrape type for DD65196: 1
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_676f6f8faf55d02f62c3342fb5020918.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_676f6f8faf55d02f62c3342fb5020918.jpg not downloaded yet
2026-03-27 19:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe75b90>
2026-03-27 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg saved to cache
2026-03-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [auto1.nl] INFO: Scrape type for UG47676: 1
2026-03-27 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN75332> (referer: https://www.auto1.com/v1/car-details-view/BN75332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-27 19:02:06 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-27 19:02:06 [auto1.nl] INFO: Scrape type for JR89598: 2
2026-03-27 19:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-27 19:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with scrape type 2
2026-03-27 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with scrape type 2
2026-03-27 19:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b, identifier: JR89598
2026-03-27 19:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB01407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD81791> (referer: https://www.auto1.com/v1/car-details-view/ZD81791/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:07 [scrapy.extensions.logstats] INFO: Crawled 93 pages (at 56 pages/min), scraped 151 items (at 99 items/min)
2026-03-27 19:02:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 182MiB
2026-03-27 19:02:07 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE22840%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [auto1.nl] INFO: Scrape type for AE22840: 2
2026-03-27 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32c27b60-1163-5720-ab38-5025afafa720 with identifier: AE22840
2026-03-27 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32c27b60-1163-5720-ab38-5025afafa720 with scrape type 2
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32c27b60-1163-5720-ab38-5025afafa720 with scrape type 2
2026-03-27 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32c27b60-1163-5720-ab38-5025afafa720, identifier: AE22840
2026-03-27 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-27 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598
2026-03-27 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e2f8f49-4a2b-524b-85a5-0f8b63eb002b with identifier: JR89598 to the API
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:45:44Z',
 'fuel_type': 'hybrid',
 'id': '3e2f8f49-4a2b-524b-85a5-0f8b63eb002b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR89598',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Hybrid T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [auto1.nl] INFO: Saving data for JR89598: {'auction_closing_time': 1774716344.0, 'created_time': 1773132873.475734, 'last_price_update_time': 1774638127.407994}
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR89598') HTTP/1.1" 204 0
2026-03-27 19:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca89ed0>
2026-03-27 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_ee3307919ff71f7957fce93d0edf58c8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_ee3307919ff71f7957fce93d0edf58c8.jpg saved to cache
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a with identifier: VH11794
2026-03-27 19:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a with scrape type 1
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_62293bf4cb55e443bc7368d38ca5dabb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_62293bf4cb55e443bc7368d38ca5dabb.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_047579b6e5763fbaa2efc958f51a36cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_047579b6e5763fbaa2efc958f51a36cd.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_8f4a897a24bbd79a68253f67f814537f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_8f4a897a24bbd79a68253f67f814537f.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_1ebcfc14aaf90b9d8b9812818543f756.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_1ebcfc14aaf90b9d8b9812818543f756.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_990e54d89955d8397967430f81e23881.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_990e54d89955d8397967430f81e23881.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_d6d4962ce2fc717abb872f68193f25af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d6d4962ce2fc717abb872f68193f25af.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_565d7d2437cd9f854c6e086546bdaaf6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_565d7d2437cd9f854c6e086546bdaaf6.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_4103f8c065275c24f01fb8c85ffb311a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_4103f8c065275c24f01fb8c85ffb311a.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_c51056a76b6c4582ec43a0ed4b9e1fb0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_c51056a76b6c4582ec43a0ed4b9e1fb0.jpg already downloaded
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F5d%252Ff45d4981c24b281849489a95894ba843%252Fpa%252FVH11794_d42e708a1f36d9d7517093ce8cb38b1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d42e708a1f36d9d7517093ce8cb38b1f.jpg already downloaded
2026-03-27 19:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a, identifier: VH11794
2026-03-27 19:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32c27b60-1163-5720-ab38-5025afafa720 with identifier: AE22840
2026-03-27 19:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32c27b60-1163-5720-ab38-5025afafa720 with identifier: AE22840
2026-03-27 19:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32c27b60-1163-5720-ab38-5025afafa720 with identifier: AE22840 to the API
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:50:59Z',
 'fuel_type': 'petrol',
 'id': '32c27b60-1163-5720-ab38-5025afafa720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE22840',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2018}
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE22840%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Saving data for AE22840: {'auction_closing_time': 1774716659.0, 'created_time': 1773232156.425321, 'last_price_update_time': 1774638128.076167}
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE22840') HTTP/1.1" 204 0
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Scrape type for KV69786: 1
2026-03-27 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a with identifier: VH11794
2026-03-27 19:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a with identifier: VH11794
2026-03-27 19:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a with identifier: VH11794 to the API
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VH11794>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:21:56Z',
 'fuel_type': 'petrol',
 'id': '4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GBV26P',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH11794',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 53884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_62293bf4cb55e443bc7368d38ca5dabb.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_047579b6e5763fbaa2efc958f51a36cd.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_8f4a897a24bbd79a68253f67f814537f.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_1ebcfc14aaf90b9d8b9812818543f756.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_990e54d89955d8397967430f81e23881.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d6d4962ce2fc717abb872f68193f25af.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_565d7d2437cd9f854c6e086546bdaaf6.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_4103f8c065275c24f01fb8c85ffb311a.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_c51056a76b6c4582ec43a0ed4b9e1fb0.jpg',
                'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d42e708a1f36d9d7517093ce8cb38b1f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_62293bf4cb55e443bc7368d38ca5dabb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_047579b6e5763fbaa2efc958f51a36cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_8f4a897a24bbd79a68253f67f814537f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_1ebcfc14aaf90b9d8b9812818543f756.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_990e54d89955d8397967430f81e23881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d6d4962ce2fc717abb872f68193f25af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_565d7d2437cd9f854c6e086546bdaaf6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_4103f8c065275c24f01fb8c85ffb311a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_c51056a76b6c4582ec43a0ed4b9e1fb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a/4e5c5cdd-c1ce-5b86-affe-ce04afbf6b6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/5d/f45d4981c24b281849489a95894ba843/pa/VH11794_d42e708a1f36d9d7517093ce8cb38b1f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH11794%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Saving data for VH11794: {'created_time': 1774638128.443625, 'last_price_update_time': 1774638128.443637, 'auction_closing_time': 1774714916.0}
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH11794') HTTP/1.1" 204 0
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Scrape type for FD60713: 1
2026-03-27 19:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-27 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 1
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_a8c996803cf4ca3a5a25a63f93cba241.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a8c996803cf4ca3a5a25a63f93cba241.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg not downloaded yet
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Scrape type for RF39867: 1
2026-03-27 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL57491> (referer: https://www.auto1.com/v1/car-details-view/AL57491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-27 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162305ee-27dd-5d3b-9ead-f25e4237fba5 with scrape type 1
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 162305ee-27dd-5d3b-9ead-f25e4237fba5
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_da613e9e9a55f9ebe30341df0bf225a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_da613e9e9a55f9ebe30341df0bf225a6.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_0119360423f157d90cf25b15a7e895da.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_0119360423f157d90cf25b15a7e895da.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_69ae814ff3218fac6d17c3073fa05a95.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_69ae814ff3218fac6d17c3073fa05a95.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_997931e8884736a19d287db1ab3189a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_997931e8884736a19d287db1ab3189a5.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_9f1b035e82c9bd63e6f201b7b74cd4aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_9f1b035e82c9bd63e6f201b7b74cd4aa.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_a65861c736ceb9377ebf9361fd6aff2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_a65861c736ceb9377ebf9361fd6aff2a.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_d7e8f2ae338c596565c5b4a95accc8e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_d7e8f2ae338c596565c5b4a95accc8e7.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_67ea35426db249f05948ffa69325bb8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_67ea35426db249f05948ffa69325bb8a.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_e25336d56ca9a249efef4725c411d831.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_e25336d56ca9a249efef4725c411d831.jpg already downloaded
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F72%252Fdb72b98d70dbc1255c8be1da39fa2502%252Fpa%252FZD81791_4fdd0217b9c8f524c31aa053b8de9dd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_4fdd0217b9c8f524c31aa053b8de9dd9.jpg already downloaded
2026-03-27 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 162305ee-27dd-5d3b-9ead-f25e4237fba5, identifier: ZD81791
2026-03-27 19:02:08 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [auto1.nl] INFO: Scrape type for TA38332: 2
2026-03-27 19:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-27 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb01572-a79d-5bf5-b117-31cec6c1a85a with scrape type 2
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb01572-a79d-5bf5-b117-31cec6c1a85a with scrape type 2
2026-03-27 19:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ccb01572-a79d-5bf5-b117-31cec6c1a85a, identifier: TA38332
2026-03-27 19:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_54cecc36803082a834f8db4bc69aad55.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_54cecc36803082a834f8db4bc69aad55.jpg not downloaded yet
2026-03-27 19:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-27 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791
2026-03-27 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 162305ee-27dd-5d3b-9ead-f25e4237fba5 with identifier: ZD81791 to the API
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD81791>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:30:57Z',
 'fuel_type': 'petrol',
 'id': '162305ee-27dd-5d3b-9ead-f25e4237fba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N702PB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD81791',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 118263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_da613e9e9a55f9ebe30341df0bf225a6.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_0119360423f157d90cf25b15a7e895da.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_69ae814ff3218fac6d17c3073fa05a95.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_997931e8884736a19d287db1ab3189a5.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_9f1b035e82c9bd63e6f201b7b74cd4aa.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_a65861c736ceb9377ebf9361fd6aff2a.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_d7e8f2ae338c596565c5b4a95accc8e7.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_67ea35426db249f05948ffa69325bb8a.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_e25336d56ca9a249efef4725c411d831.jpg',
                'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_4fdd0217b9c8f524c31aa053b8de9dd9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_da613e9e9a55f9ebe30341df0bf225a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_0119360423f157d90cf25b15a7e895da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_69ae814ff3218fac6d17c3073fa05a95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_997931e8884736a19d287db1ab3189a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_9f1b035e82c9bd63e6f201b7b74cd4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_a65861c736ceb9377ebf9361fd6aff2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_d7e8f2ae338c596565c5b4a95accc8e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_67ea35426db249f05948ffa69325bb8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_e25336d56ca9a249efef4725c411d831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_162305ee-27dd-5d3b-9ead-f25e4237fba5/162305ee-27dd-5d3b-9ead-f25e4237fba5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/72/db72b98d70dbc1255c8be1da39fa2502/pa/ZD81791_4fdd0217b9c8f524c31aa053b8de9dd9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-27 19:02:09 [auto1.nl] INFO: Saving data for ZD81791: {'created_time': 1774638129.291646, 'last_price_update_time': 1774638129.291657, 'auction_closing_time': 1774715457.0}
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZD81791') HTTP/1.1" 204 0
2026-03-27 19:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-27 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332
2026-03-27 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ccb01572-a79d-5bf5-b117-31cec6c1a85a with identifier: TA38332 to the API
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:19Z',
 'fuel_type': 'petrol',
 'id': 'ccb01572-a79d-5bf5-b117-31cec6c1a85a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA38332',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 255998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-05',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T3 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-27 19:02:09 [auto1.nl] INFO: Saving data for TA38332: {'auction_closing_time': 1774713979.0, 'created_time': 1773133312.387999, 'last_price_update_time': 1774638129.670181}
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA38332') HTTP/1.1" 204 0
2026-03-27 19:02:09 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-27 19:02:09 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-27 19:02:09 [auto1.nl] INFO: Scrape type for TC30391: 2
2026-03-27 19:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-27 19:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769ddca8-1daa-5c77-a985-a925d69465af with scrape type 2
2026-03-27 19:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769ddca8-1daa-5c77-a985-a925d69465af with scrape type 2
2026-03-27 19:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 769ddca8-1daa-5c77-a985-a925d69465af, identifier: TC30391
2026-03-27 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_676f6f8faf55d02f62c3342fb5020918.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:09 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU52252%27 HTTP/1.1" 200 None
2026-03-27 19:02:09 [auto1.nl] INFO: Scrape type for WU52252: 1
2026-03-27 19:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-27 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391
2026-03-27 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 769ddca8-1daa-5c77-a985-a925d69465af with identifier: TC30391 to the API
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:01Z',
 'fuel_type': 'petrol',
 'id': '769ddca8-1daa-5c77-a985-a925d69465af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC30391',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 181704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-12',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2009}
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Saving data for TC30391: {'auction_closing_time': 1774714681.0, 'created_time': 1773947231.237206, 'last_price_update_time': 1774638130.076882}
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC30391') HTTP/1.1" 204 0
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_e5fdccb907fb82902ead57998b1d255f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_e5fdccb907fb82902ead57998b1d255f.jpg not downloaded yet
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG63197%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for NG63197: 1
2026-03-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY02674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:10 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 916 | hits on page: 40
2026-03-27 19:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39141fa5-6e43-5c84-aaab-2419efc17585 with scrape type 1
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_718dfd9a302893ca51754a3d13e3aad3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_718dfd9a302893ca51754a3d13e3aad3.jpg not downloaded yet
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for WV54622: 1
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg not downloaded yet
2026-03-27 19:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for KA53212: 2
2026-03-27 19:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95803e74-134a-5083-8fa3-7bd184c15d8d with scrape type 2
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95803e74-134a-5083-8fa3-7bd184c15d8d with scrape type 2
2026-03-27 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 95803e74-134a-5083-8fa3-7bd184c15d8d, identifier: KA53212
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for DE05380: 1
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg not downloaded yet
2026-03-27 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ec0d850>
2026-03-27 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_676f6f8faf55d02f62c3342fb5020918.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_676f6f8faf55d02f62c3342fb5020918.jpg saved to cache
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-27 19:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212
2026-03-27 19:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 95803e74-134a-5083-8fa3-7bd184c15d8d with identifier: KA53212 to the API
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:47:24Z',
 'fuel_type': 'diesel',
 'id': '95803e74-134a-5083-8fa3-7bd184c15d8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA53212',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 288012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TD FT 300 Kurz',
 'transmission': 'manual',
 'trim': 'FT 300 Kurz',
 'year': 2002}
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Saving data for KA53212: {'auction_closing_time': 1774716444.0, 'created_time': 1773921686.672025, 'last_price_update_time': 1774638130.724964}
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KA53212') HTTP/1.1" 204 0
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_175269ca1cea5830733c4415ed83782a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_175269ca1cea5830733c4415ed83782a.jpg not downloaded yet
2026-03-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_54cecc36803082a834f8db4bc69aad55.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for UD40907: 1
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for VC22580: 1
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_3cccc5473be56f84bcc0881b3160c004.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_3cccc5473be56f84bcc0881b3160c004.jpg not downloaded yet
2026-03-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_e5fdccb907fb82902ead57998b1d255f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD56346%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for UD56346: 1
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for RL60639: 1
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg not downloaded yet
2026-03-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV95890/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF88410/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:10 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-27 19:02:10 [auto1.nl] INFO: Scrape type for ZA96365: 2
2026-03-27 19:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-27 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e17aac-f34e-5577-800b-58cdb3a259fe with scrape type 2
2026-03-27 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e17aac-f34e-5577-800b-58cdb3a259fe with scrape type 2
2026-03-27 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 16e17aac-f34e-5577-800b-58cdb3a259fe, identifier: ZA96365
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Scrape type for GY00070: 1
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_d9667633295da188d4a4c1fe76a70b53.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9667633295da188d4a4c1fe76a70b53.jpg not downloaded yet
2026-03-27 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-27 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365
2026-03-27 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 16e17aac-f34e-5577-800b-58cdb3a259fe with identifier: ZA96365 to the API
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:05:31Z',
 'fuel_type': 'petrol',
 'id': '16e17aac-f34e-5577-800b-58cdb3a259fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA96365',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 347947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-08',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Saving data for ZA96365: {'auction_closing_time': 1774713931.0, 'created_time': 1773922784.681273, 'last_price_update_time': 1774638131.385552}
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZA96365') HTTP/1.1" 204 0
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JP82620> (referer: https://www.auto1.com/v1/car-details-view/JP82620/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_175269ca1cea5830733c4415ed83782a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH96879%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Scrape type for HH96879: 1
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Scrape type for HR88481: 1
2026-03-27 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb48a10>
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_54cecc36803082a834f8db4bc69aad55.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_54cecc36803082a834f8db4bc69aad55.jpg saved to cache
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca1fd90>
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_e5fdccb907fb82902ead57998b1d255f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_e5fdccb907fb82902ead57998b1d255f.jpg saved to cache
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Scrape type for ML76723: 1
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG47676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-27 19:02:11 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [auto1.nl] INFO: Scrape type for FB74313: 2
2026-03-27 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-27 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ad33247-a60d-5667-8c2c-b5b47235c678 with scrape type 2
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ad33247-a60d-5667-8c2c-b5b47235c678 with scrape type 2
2026-03-27 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1ad33247-a60d-5667-8c2c-b5b47235c678, identifier: FB74313
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM92541> (referer: https://www.auto1.com/v1/car-details-view/RM92541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-27 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cbce85e-97df-5832-9937-7d228282e156 with scrape type 1
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_1136a5d368211d282dcb8f35119ac33b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_1136a5d368211d282dcb8f35119ac33b.jpg not downloaded yet
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffc86d0>
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_175269ca1cea5830733c4415ed83782a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_175269ca1cea5830733c4415ed83782a.jpg saved to cache
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff34c50>
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg saved to cache
2026-03-27 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-27 19:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313
2026-03-27 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1ad33247-a60d-5667-8c2c-b5b47235c678 with identifier: FB74313 to the API
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:09Z',
 'fuel_type': 'petrol',
 'id': '1ad33247-a60d-5667-8c2c-b5b47235c678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB74313',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 134242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-02',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [auto1.nl] INFO: Saving data for FB74313: {'auction_closing_time': 1774715649.0, 'created_time': 1773133520.509048, 'last_price_update_time': 1774638132.246325}
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB74313') HTTP/1.1" 204 0
2026-03-27 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:12 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [auto1.nl] INFO: Scrape type for JS19868: 2
2026-03-27 19:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-27 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ad857e-8b62-59c4-a946-083edad8258d with scrape type 2
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ad857e-8b62-59c4-a946-083edad8258d with scrape type 2
2026-03-27 19:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 58ad857e-8b62-59c4-a946-083edad8258d, identifier: JS19868
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg not downloaded yet
2026-03-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9667633295da188d4a4c1fe76a70b53.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-27 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868
2026-03-27 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 58ad857e-8b62-59c4-a946-083edad8258d with identifier: JS19868 to the API
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:35:32Z',
 'fuel_type': 'petrol',
 'id': '58ad857e-8b62-59c4-a946-083edad8258d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS19868',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 108990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2016}
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [auto1.nl] INFO: Saving data for JS19868: {'auction_closing_time': 1774715732.0, 'created_time': 1773923122.641547, 'last_price_update_time': 1774638132.753532}
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS19868') HTTP/1.1" 204 0
2026-03-27 19:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-27 19:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with scrape type 1
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_839deb701bbb917360118d3e92d285cd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_839deb701bbb917360118d3e92d285cd.jpg not downloaded yet
2026-03-27 19:02:12 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [auto1.nl] INFO: Scrape type for TN92622: 1
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_42eb3d1670981950dd1855889129cb20.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_42eb3d1670981950dd1855889129cb20.jpg not downloaded yet
2026-03-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD65196/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb47890>
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg saved to cache
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_dae057bb0123e9b219219f9e3d75de74.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_dae057bb0123e9b219219f9e3d75de74.jpg not downloaded yet
2026-03-27 19:02:12 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY79842%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [auto1.nl] INFO: Scrape type for NY79842: 1
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_9cc07490e23034c7560cefd21f44a155.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_9cc07490e23034c7560cefd21f44a155.jpg not downloaded yet
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd1f0d0>
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_d9667633295da188d4a4c1fe76a70b53.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9667633295da188d4a4c1fe76a70b53.jpg saved to cache
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_6d23434247dcce91b3748a308cc7d909.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_6d23434247dcce91b3748a308cc7d909.jpg not downloaded yet
2026-03-27 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF42307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for VJ86590: 1
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_d048828ce3b22eee4e9a92c818349bbb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_d048828ce3b22eee4e9a92c818349bbb.jpg not downloaded yet
2026-03-27 19:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_1136a5d368211d282dcb8f35119ac33b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg not downloaded yet
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_3a0e00b2033794f953d824e543b71ad8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for UV82075: 1
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_010d3b7c19c2c43b32729371f0139371.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_010d3b7c19c2c43b32729371f0139371.jpg not downloaded yet
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_70603d656aac994c9b2a435765a71fb0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_7a34968ed051220f2266722b9650b740.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_7a34968ed051220f2266722b9650b740.jpg not downloaded yet
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ92302%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for TJ92302: 1
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_f424ab9b66815b153c6e86dfa425adc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_f424ab9b66815b153c6e86dfa425adc8.jpg not downloaded yet
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for PM71197: 2
2026-03-27 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-27 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with scrape type 2
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with scrape type 2
2026-03-27 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 12e6d916-46a6-5392-ba4f-b2228deeb1e4, identifier: PM71197
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_25096562a1f3e0608af24f4ef81bf636.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_25096562a1f3e0608af24f4ef81bf636.jpg not downloaded yet
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_6d23434247dcce91b3748a308cc7d909.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-27 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197
2026-03-27 19:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 12e6d916-46a6-5392-ba4f-b2228deeb1e4 with identifier: PM71197 to the API
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:44:50Z',
 'fuel_type': 'petrol',
 'id': '12e6d916-46a6-5392-ba4f-b2228deeb1e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM71197',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 151062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Saving data for PM71197: {'auction_closing_time': 1774716290.0, 'created_time': 1773921657.450634, 'last_price_update_time': 1774638133.568512}
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PM71197') HTTP/1.1" 204 0
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_9cc07490e23034c7560cefd21f44a155.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for XY26028: 1
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_71121a4ffe9d0dca25b7486557d47852.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_71121a4ffe9d0dca25b7486557d47852.jpg not downloaded yet
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c979710>
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_1136a5d368211d282dcb8f35119ac33b.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_1136a5d368211d282dcb8f35119ac33b.jpg saved to cache
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c967410>
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_3a0e00b2033794f953d824e543b71ad8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_3a0e00b2033794f953d824e543b71ad8.jpg saved to cache
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_42eb3d1670981950dd1855889129cb20.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_d048828ce3b22eee4e9a92c818349bbb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-27 19:02:13 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [auto1.nl] INFO: Scrape type for HZ03058: 2
2026-03-27 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-27 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988cee1f-30bd-5944-9256-9363d70e1856 with scrape type 2
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988cee1f-30bd-5944-9256-9363d70e1856 with scrape type 2
2026-03-27 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 988cee1f-30bd-5944-9256-9363d70e1856, identifier: HZ03058
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_2103692d388d147abf6b150f4a870600.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2103692d388d147abf6b150f4a870600.jpg not downloaded yet
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY00070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF39867/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB01407> (referer: https://www.auto1.com/v1/car-details-view/KB01407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY02674> (referer: https://www.auto1.com/v1/car-details-view/TY02674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8c1150>
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_70603d656aac994c9b2a435765a71fb0.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_70603d656aac994c9b2a435765a71fb0.jpg saved to cache
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca45d50>
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_6d23434247dcce91b3748a308cc7d909.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_6d23434247dcce91b3748a308cc7d909.jpg saved to cache
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-27 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058
2026-03-27 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 988cee1f-30bd-5944-9256-9363d70e1856 with identifier: HZ03058 to the API
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:34Z',
 'fuel_type': 'petrol',
 'id': '988cee1f-30bd-5944-9256-9363d70e1856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ03058',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 73629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Version S',
 'transmission': 'automatic',
 'trim': 'Version S',
 'year': 2019}
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [auto1.nl] INFO: Saving data for HZ03058: {'auction_closing_time': 1774714534.0, 'created_time': 1773921662.480183, 'last_price_update_time': 1774638134.50809}
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HZ03058') HTTP/1.1" 204 0
2026-03-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL60639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:14 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-27 19:02:14 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [auto1.nl] INFO: Scrape type for GD83498: 1
2026-03-27 19:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffadfd0>
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_9cc07490e23034c7560cefd21f44a155.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_9cc07490e23034c7560cefd21f44a155.jpg saved to cache
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_61021ed2062857709f39dcec874e9f6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_39f3bf739cec027e726857605f2628a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda57d0>
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_42eb3d1670981950dd1855889129cb20.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_42eb3d1670981950dd1855889129cb20.jpg saved to cache
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd5a510>
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_d048828ce3b22eee4e9a92c818349bbb.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_d048828ce3b22eee4e9a92c818349bbb.jpg saved to cache
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-27 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e857dcdf-46d7-532f-b4c8-916b86cbc300 with scrape type 1
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e857dcdf-46d7-532f-b4c8-916b86cbc300
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_01cbc467b8382b706d5869424c7348d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_01cbc467b8382b706d5869424c7348d8.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_3c4e09eebd34f2d9fe09d2a6f5e7a606.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3c4e09eebd34f2d9fe09d2a6f5e7a606.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_bed21aaa300af9a953b203af2876906a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_bed21aaa300af9a953b203af2876906a.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_67907310928f6789d10d0588d8fb64a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_67907310928f6789d10d0588d8fb64a1.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_1fc3bbf8d6e0a834156abc1f88f24f92.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_1fc3bbf8d6e0a834156abc1f88f24f92.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_078d14f990f3315f88dd9898982990f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_078d14f990f3315f88dd9898982990f1.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_3460f1d6afff4a2c514111d1d80f4feb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3460f1d6afff4a2c514111d1d80f4feb.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_c74a1b2cceabc3de6e28c4fdfb259059.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_c74a1b2cceabc3de6e28c4fdfb259059.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_ae92610edac9e8e60c54787d4cc46dd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_ae92610edac9e8e60c54787d4cc46dd3.jpg already downloaded
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F18%252F0618ce5116af47be6176c2d22b11488b%252Fpa%252FKB01407_af63a8f32c80ebac8001bd479a77922e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_af63a8f32c80ebac8001bd479a77922e.jpg already downloaded
2026-03-27 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e857dcdf-46d7-532f-b4c8-916b86cbc300, identifier: KB01407
2026-03-27 19:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22f201ce-3b7b-5837-b1b0-604b91c7475f with identifier: TY02674
2026-03-27 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f201ce-3b7b-5837-b1b0-604b91c7475f with scrape type 1
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg not downloaded yet
2026-03-27 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-27 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407
2026-03-27 19:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e857dcdf-46d7-532f-b4c8-916b86cbc300 with identifier: KB01407 to the API
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB01407>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:10Z',
 'fuel_type': 'petrol',
 'id': 'e857dcdf-46d7-532f-b4c8-916b86cbc300',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'K707ZF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB01407',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 88147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_01cbc467b8382b706d5869424c7348d8.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3c4e09eebd34f2d9fe09d2a6f5e7a606.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_bed21aaa300af9a953b203af2876906a.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_67907310928f6789d10d0588d8fb64a1.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_1fc3bbf8d6e0a834156abc1f88f24f92.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_078d14f990f3315f88dd9898982990f1.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3460f1d6afff4a2c514111d1d80f4feb.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_c74a1b2cceabc3de6e28c4fdfb259059.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_ae92610edac9e8e60c54787d4cc46dd3.jpg',
                'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_af63a8f32c80ebac8001bd479a77922e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_01cbc467b8382b706d5869424c7348d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3c4e09eebd34f2d9fe09d2a6f5e7a606.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_bed21aaa300af9a953b203af2876906a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_67907310928f6789d10d0588d8fb64a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_1fc3bbf8d6e0a834156abc1f88f24f92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_078d14f990f3315f88dd9898982990f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_3460f1d6afff4a2c514111d1d80f4feb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_c74a1b2cceabc3de6e28c4fdfb259059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_ae92610edac9e8e60c54787d4cc46dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e857dcdf-46d7-532f-b4c8-916b86cbc300/e857dcdf-46d7-532f-b4c8-916b86cbc300_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/18/0618ce5116af47be6176c2d22b11488b/pa/KB01407_af63a8f32c80ebac8001bd479a77922e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2021}
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [auto1.nl] INFO: Saving data for KB01407: {'created_time': 1774638135.308064, 'last_price_update_time': 1774638135.308077, 'auction_closing_time': 1774715290.0}
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB01407') HTTP/1.1" 204 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_b4c83551743c5de01bcb25a95be56bfc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b4c83551743c5de01bcb25a95be56bfc.jpg not downloaded yet
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_7a34968ed051220f2266722b9650b740.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_f424ab9b66815b153c6e86dfa425adc8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_010d3b7c19c2c43b32729371f0139371.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2103692d388d147abf6b150f4a870600.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg not downloaded yet
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML76723/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9fc50>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_61021ed2062857709f39dcec874e9f6d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_61021ed2062857709f39dcec874e9f6d.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9caaecd0>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_39f3bf739cec027e726857605f2628a5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_39f3bf739cec027e726857605f2628a5.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_130286151ba13866d4ddd4e532dcfa3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_130286151ba13866d4ddd4e532dcfa3f.jpg not downloaded yet
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_71121a4ffe9d0dca25b7486557d47852.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8fe590>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_7a34968ed051220f2266722b9650b740.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_7a34968ed051220f2266722b9650b740.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca975d0>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_f424ab9b66815b153c6e86dfa425adc8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_f424ab9b66815b153c6e86dfa425adc8.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd49150>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_010d3b7c19c2c43b32729371f0139371.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_010d3b7c19c2c43b32729371f0139371.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff766d0>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_2103692d388d147abf6b150f4a870600.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2103692d388d147abf6b150f4a870600.jpg saved to cache
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_25096562a1f3e0608af24f4ef81bf636.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg not downloaded yet
2026-03-27 19:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_7bb4e97ec56e97f643c281592503f121.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_7bb4e97ec56e97f643c281592503f121.jpg not downloaded yet
2026-03-27 19:02:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff73e10>
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_71121a4ffe9d0dca25b7486557d47852.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_71121a4ffe9d0dca25b7486557d47852.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg not downloaded yet
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg not downloaded yet
2026-03-27 19:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fea4d90>
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_25096562a1f3e0608af24f4ef81bf636.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_25096562a1f3e0608af24f4ef81bf636.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg not downloaded yet
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg not downloaded yet
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b4c83551743c5de01bcb25a95be56bfc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c99d710>
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY26028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff26910>
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_b4c83551743c5de01bcb25a95be56bfc.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b4c83551743c5de01bcb25a95be56bfc.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ92302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV82075/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_7bb4e97ec56e97f643c281592503f121.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF42307> (referer: https://www.auto1.com/v1/car-details-view/NF42307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV95890> (referer: https://www.auto1.com/v1/car-details-view/DV95890/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe88790>
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff3b5d0>
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_7bb4e97ec56e97f643c281592503f121.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_7bb4e97ec56e97f643c281592503f121.jpg saved to cache
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-27 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ed3611-9a15-5ad8-a3f5-64882f276078 with scrape type 1
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 07ed3611-9a15-5ad8-a3f5-64882f276078
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F56%252Fb856551107cf0c6757da9a40e83ef886%252Fpa%252FNF42307_5f98c45fb2f73d9f4accbd0dde234a26.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_5f98c45fb2f73d9f4accbd0dde234a26.jpg already downloaded
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F56%252Fb856551107cf0c6757da9a40e83ef886%252Fpa%252FNF42307_d7309e2ff15bfac3a784c2b64a0c26d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_d7309e2ff15bfac3a784c2b64a0c26d6.jpg already downloaded
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F56%252Fb856551107cf0c6757da9a40e83ef886%252Fpa%252FNF42307_216ac1100309122814cf65c63df772d8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_216ac1100309122814cf65c63df772d8.jpg already downloaded
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F56%252Fb856551107cf0c6757da9a40e83ef886%252Fpa%252FNF42307_cdd1a3ca1173ad3580ffe7ebc910138f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_cdd1a3ca1173ad3580ffe7ebc910138f.jpg already downloaded
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F56%252Fb856551107cf0c6757da9a40e83ef886%252Fpa%252FNF42307_00afece0c4c34b20e231507d1aeecbaf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_00afece0c4c34b20e231507d1aeecbaf.jpg already downloaded
2026-03-27 19:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07ed3611-9a15-5ad8-a3f5-64882f276078, identifier: NF42307
2026-03-27 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943a1218-8bcf-5e30-b15f-56707b149dba with identifier: DV95890
2026-03-27 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943a1218-8bcf-5e30-b15f-56707b149dba with scrape type 1
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 943a1218-8bcf-5e30-b15f-56707b149dba
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg not downloaded yet
2026-03-27 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-27 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307
2026-03-27 19:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07ed3611-9a15-5ad8-a3f5-64882f276078 with identifier: NF42307 to the API
2026-03-27 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF42307>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:08:59Z',
 'fuel_type': 'petrol',
 'id': '07ed3611-9a15-5ad8-a3f5-64882f276078',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JK092J',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF42307',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 104886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_5f98c45fb2f73d9f4accbd0dde234a26.jpg',
                'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_d7309e2ff15bfac3a784c2b64a0c26d6.jpg',
                'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_216ac1100309122814cf65c63df772d8.jpg',
                'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_cdd1a3ca1173ad3580ffe7ebc910138f.jpg',
                'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_00afece0c4c34b20e231507d1aeecbaf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ed3611-9a15-5ad8-a3f5-64882f276078/07ed3611-9a15-5ad8-a3f5-64882f276078_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_5f98c45fb2f73d9f4accbd0dde234a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ed3611-9a15-5ad8-a3f5-64882f276078/07ed3611-9a15-5ad8-a3f5-64882f276078_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_d7309e2ff15bfac3a784c2b64a0c26d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ed3611-9a15-5ad8-a3f5-64882f276078/07ed3611-9a15-5ad8-a3f5-64882f276078_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_216ac1100309122814cf65c63df772d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ed3611-9a15-5ad8-a3f5-64882f276078/07ed3611-9a15-5ad8-a3f5-64882f276078_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_cdd1a3ca1173ad3580ffe7ebc910138f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07ed3611-9a15-5ad8-a3f5-64882f276078/07ed3611-9a15-5ad8-a3f5-64882f276078_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/56/b856551107cf0c6757da9a40e83ef886/pa/NF42307_00afece0c4c34b20e231507d1aeecbaf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [auto1.nl] INFO: Saving data for NF42307: {'created_time': 1774638137.199035, 'last_price_update_time': 1774638137.199046, 'auction_closing_time': 1774714139.0}
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NF42307') HTTP/1.1" 204 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_9d487276436cd95300f5eddd3aa3d49c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_9d487276436cd95300f5eddd3aa3d49c.jpg not downloaded yet
2026-03-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_130286151ba13866d4ddd4e532dcfa3f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg not downloaded yet
2026-03-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL60639> (referer: https://www.auto1.com/v1/car-details-view/RL60639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd8bf50>
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg saved to cache
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb81e90>
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg saved to cache
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd4a750>
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg saved to cache
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c943ed0>
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg saved to cache
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_0f99401dfcc375c6232776a554e00fe5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_0f99401dfcc375c6232776a554e00fe5.jpg not downloaded yet
2026-03-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF39867> (referer: https://www.auto1.com/v1/car-details-view/RF39867/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca60fd0>
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_130286151ba13866d4ddd4e532dcfa3f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_130286151ba13866d4ddd4e532dcfa3f.jpg saved to cache
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-27 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2be61198-ed56-5fa9-b4a6-6a7834108b63 with scrape type 1
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2be61198-ed56-5fa9-b4a6-6a7834108b63
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_db636a97012d8820d533f1f8f57f3dd4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_db636a97012d8820d533f1f8f57f3dd4.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_5c8f37edfaccd7fad9a81aaccedebd7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5c8f37edfaccd7fad9a81aaccedebd7e.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_4c080bbc51a2ebd15d7eef929da5d498.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4c080bbc51a2ebd15d7eef929da5d498.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_53dee7ecf589a3ffc0080a17d3bb6743.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_53dee7ecf589a3ffc0080a17d3bb6743.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_8575900aa3ee244aa3953c87e29e3ac3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_8575900aa3ee244aa3953c87e29e3ac3.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_166d208e9e7738411efd5c1f6ca67017.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_166d208e9e7738411efd5c1f6ca67017.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_5f7d475356ea6ad7eaa4c5bf6b004024.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5f7d475356ea6ad7eaa4c5bf6b004024.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_2c86dea2afa2df01a8e2dd37a70c4361.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2c86dea2afa2df01a8e2dd37a70c4361.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_2bb4db3890ca534117ba94f64ddeb625.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2bb4db3890ca534117ba94f64ddeb625.jpg already downloaded
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F1c%252F741cffbd3aeef0e2dc361b79c674e9ef%252Fpa%252FRL60639_4654551ea7721e1855883ea640bab97c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4654551ea7721e1855883ea640bab97c.jpg already downloaded
2026-03-27 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2be61198-ed56-5fa9-b4a6-6a7834108b63, identifier: RL60639
2026-03-27 19:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-27 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639
2026-03-27 19:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2be61198-ed56-5fa9-b4a6-6a7834108b63 with identifier: RL60639 to the API
2026-03-27 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL60639>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:17Z',
 'fuel_type': 'petrol',
 'id': '2be61198-ed56-5fa9-b4a6-6a7834108b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XR280R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL60639',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_db636a97012d8820d533f1f8f57f3dd4.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5c8f37edfaccd7fad9a81aaccedebd7e.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4c080bbc51a2ebd15d7eef929da5d498.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_53dee7ecf589a3ffc0080a17d3bb6743.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_8575900aa3ee244aa3953c87e29e3ac3.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_166d208e9e7738411efd5c1f6ca67017.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5f7d475356ea6ad7eaa4c5bf6b004024.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2c86dea2afa2df01a8e2dd37a70c4361.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2bb4db3890ca534117ba94f64ddeb625.jpg',
                'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4654551ea7721e1855883ea640bab97c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_db636a97012d8820d533f1f8f57f3dd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414850,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5c8f37edfaccd7fad9a81aaccedebd7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439428,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4c080bbc51a2ebd15d7eef929da5d498.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_53dee7ecf589a3ffc0080a17d3bb6743.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_8575900aa3ee244aa3953c87e29e3ac3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_166d208e9e7738411efd5c1f6ca67017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_5f7d475356ea6ad7eaa4c5bf6b004024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2c86dea2afa2df01a8e2dd37a70c4361.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_2bb4db3890ca534117ba94f64ddeb625.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2be61198-ed56-5fa9-b4a6-6a7834108b63/2be61198-ed56-5fa9-b4a6-6a7834108b63_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/1c/741cffbd3aeef0e2dc361b79c674e9ef/pa/RL60639_4654551ea7721e1855883ea640bab97c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [auto1.nl] INFO: Saving data for RL60639: {'created_time': 1774638138.186266, 'last_price_update_time': 1774638138.186278, 'auction_closing_time': 1774716977.0}
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL60639') HTTP/1.1" 204 0
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_9d487276436cd95300f5eddd3aa3d49c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML76723> (referer: https://www.auto1.com/v1/car-details-view/ML76723/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9e93b210>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 943a1218-8bcf-5e30-b15f-56707b149dba
2026-03-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with scrape type 1
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_0f214e7086a9c27db7674f32ea4890b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_0f214e7086a9c27db7674f32ea4890b0.jpg not downloaded yet
2026-03-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY00070> (referer: https://www.auto1.com/v1/car-details-view/GY00070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD65196> (referer: https://www.auto1.com/v1/car-details-view/DD65196/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD83498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_e004006f786b7190eaed30e8ee8a9481.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_e004006f786b7190eaed30e8ee8a9481.jpg not downloaded yet
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg not downloaded yet
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_a121049a41595269d124e1200ca5905b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_a121049a41595269d124e1200ca5905b.jpg not downloaded yet
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8c4250>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_9d487276436cd95300f5eddd3aa3d49c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_9d487276436cd95300f5eddd3aa3d49c.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 943a1218-8bcf-5e30-b15f-56707b149dba
2026-03-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with scrape type 1
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg not downloaded yet
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_dae057bb0123e9b219219f9e3d75de74.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_cc47c74b4043302da09804323c12714d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_cc47c74b4043302da09804323c12714d.jpg not downloaded yet
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_0f214e7086a9c27db7674f32ea4890b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_94f2241e6715440a813763c4e8976ba6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_94f2241e6715440a813763c4e8976ba6.jpg not downloaded yet
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_839deb701bbb917360118d3e92d285cd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_0f99401dfcc375c6232776a554e00fe5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_006ae6c78562459d939a37ae2088be8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_006ae6c78562459d939a37ae2088be8f.jpg not downloaded yet
2026-03-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfe957d-07da-58b3-b64d-f237cbadc483 with scrape type 1
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_14b32750aa36ad1f854559a27624cf68.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_14b32750aa36ad1f854559a27624cf68.jpg not downloaded yet
2026-03-27 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beeb97f8-8f52-56aa-9079-b6f8934586d5 with scrape type 1
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_3d910de5afd00be78ff2c7400d51d87f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_3d910de5afd00be78ff2c7400d51d87f.jpg not downloaded yet
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ebda7d0>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 943a1218-8bcf-5e30-b15f-56707b149dba
2026-03-27 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_e004006f786b7190eaed30e8ee8a9481.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg not downloaded yet
2026-03-27 19:02:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb48910>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg not downloaded yet
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_98877960e0c2a89ea04bac9b3999d562.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_98877960e0c2a89ea04bac9b3999d562.jpg not downloaded yet
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg not downloaded yet
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_6aabf8949dacfd01740b2d0b079dc864.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_6aabf8949dacfd01740b2d0b079dc864.jpg not downloaded yet
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c97c1d0>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_dae057bb0123e9b219219f9e3d75de74.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_dae057bb0123e9b219219f9e3d75de74.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe8ba50>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_0f214e7086a9c27db7674f32ea4890b0.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_0f214e7086a9c27db7674f32ea4890b0.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff6da10>
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F53%252F57530a338ef23de3048aef693f393faa%252Fpa%252FRM92541_839deb701bbb917360118d3e92d285cd.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_839deb701bbb917360118d3e92d285cd.jpg saved to cache
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a
2026-03-27 19:02:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a, skipping ID generation
2026-03-27 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with scrape type 1
2026-03-27 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d30c90e-fe5c-5f7c-969d-2e9401806f6a sending to next pipeline
2026-03-27 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a, identifier: RM92541
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb7f3d0>
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252F40%252Ff440a3d9573e837e6f18376b401de1db%252Fpa%252FDV95890_0f99401dfcc375c6232776a554e00fe5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_0f99401dfcc375c6232776a554e00fe5.jpg saved to cache
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 943a1218-8bcf-5e30-b15f-56707b149dba
2026-03-27 19:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 943a1218-8bcf-5e30-b15f-56707b149dba, skipping ID generation
2026-03-27 19:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943a1218-8bcf-5e30-b15f-56707b149dba with scrape type 1
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 943a1218-8bcf-5e30-b15f-56707b149dba sending to next pipeline
2026-03-27 19:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 943a1218-8bcf-5e30-b15f-56707b149dba, identifier: DV95890
2026-03-27 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg not downloaded yet
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg not downloaded yet
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_361c38734c5c3cc45d12d68dfe7db363.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_361c38734c5c3cc45d12d68dfe7db363.jpg not downloaded yet
2026-03-27 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-27 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541
2026-03-27 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d30c90e-fe5c-5f7c-969d-2e9401806f6a with identifier: RM92541 to the API
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_839deb701bbb917360118d3e92d285cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:12:32Z',
 'fuel_type': 'petrol',
 'id': '1d30c90e-fe5c-5f7c-969d-2e9401806f6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PF991H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM92541',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 235083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_839deb701bbb917360118d3e92d285cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_dae057bb0123e9b219219f9e3d75de74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_6d23434247dcce91b3748a308cc7d909.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_fda6aa32f9e3eabffac14ea207ab1267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d30c90e-fe5c-5f7c-969d-2e9401806f6a/1d30c90e-fe5c-5f7c-969d-2e9401806f6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/53/57530a338ef23de3048aef693f393faa/pa/RM92541_7a34968ed051220f2266722b9650b740.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TFSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2007}
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [auto1.nl] INFO: Saving data for RM92541: {'created_time': 1774638139.542216, 'last_price_update_time': 1774638139.542227, 'auction_closing_time': 1774714352.0}
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RM92541') HTTP/1.1" 204 0
2026-03-27 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 943a1218-8bcf-5e30-b15f-56707b149dba with identifier: DV95890
2026-03-27 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 943a1218-8bcf-5e30-b15f-56707b149dba with identifier: DV95890
2026-03-27 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 943a1218-8bcf-5e30-b15f-56707b149dba with identifier: DV95890 to the API
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_0f99401dfcc375c6232776a554e00fe5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:26:02Z',
 'fuel_type': 'petrol',
 'id': '943a1218-8bcf-5e30-b15f-56707b149dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H451RS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV95890',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 178329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_bfdbd93dc78a843558ce6cf84e16fb46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_9d487276436cd95300f5eddd3aa3d49c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_a35b72433cb0fcf54ae5016ca9bdbbe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_943a1218-8bcf-5e30-b15f-56707b149dba/943a1218-8bcf-5e30-b15f-56707b149dba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/40/f440a3d9573e837e6f18376b401de1db/pa/DV95890_0f99401dfcc375c6232776a554e00fe5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV95890%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [auto1.nl] INFO: Saving data for DV95890: {'created_time': 1774638139.866994, 'last_price_update_time': 1774638139.867005, 'auction_closing_time': 1774715162.0}
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DV95890') HTTP/1.1" 204 0
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb36b10>
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_e004006f786b7190eaed30e8ee8a9481.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_e004006f786b7190eaed30e8ee8a9481.jpg saved to cache
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_94f2241e6715440a813763c4e8976ba6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg not downloaded yet
2026-03-27 19:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg not downloaded yet
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_6910f9dcf4da56f3103d233c3f17217a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_6910f9dcf4da56f3103d233c3f17217a.jpg not downloaded yet
2026-03-27 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg not downloaded yet
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN92622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY79842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY26028> (referer: https://www.auto1.com/v1/car-details-view/XY26028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV82075> (referer: https://www.auto1.com/v1/car-details-view/UV82075/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca82150>
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg saved to cache
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_a121049a41595269d124e1200ca5905b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_90244c7db0fa841f01670ba894462f38.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_90244c7db0fa841f01670ba894462f38.jpg not downloaded yet
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg not downloaded yet
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_bec2506339b183f0999146aad47bd200.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_bec2506339b183f0999146aad47bd200.jpg not downloaded yet
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ86590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9d4a90>
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_94f2241e6715440a813763c4e8976ba6.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_94f2241e6715440a813763c4e8976ba6.jpg saved to cache
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c964250>
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252F2f%252F6a2f148054823f7992f2932c386b0193%252Fpa%252FJP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg saved to cache
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cbce85e-97df-5832-9937-7d228282e156
2026-03-27 19:02:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cbce85e-97df-5832-9937-7d228282e156, skipping ID generation
2026-03-27 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cbce85e-97df-5832-9937-7d228282e156 with scrape type 1
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cbce85e-97df-5832-9937-7d228282e156 sending to next pipeline
2026-03-27 19:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8cbce85e-97df-5832-9937-7d228282e156, identifier: JP82620
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_361c38734c5c3cc45d12d68dfe7db363.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ92302> (referer: https://www.auto1.com/v1/car-details-view/TJ92302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-27 19:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620
2026-03-27 19:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8cbce85e-97df-5832-9937-7d228282e156 with identifier: JP82620 to the API
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:05:34Z',
 'fuel_type': 'petrol',
 'id': '8cbce85e-97df-5832-9937-7d228282e156',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '05JPN5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP82620',
 'listing': 'auction',
 'location': 'NL, Gouda',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 204901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_1136a5d368211d282dcb8f35119ac33b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2089fb15c4fc096abd2ead1c397ea1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_42eb3d1670981950dd1855889129cb20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_9cc07490e23034c7560cefd21f44a155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_d048828ce3b22eee4e9a92c818349bbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_010d3b7c19c2c43b32729371f0139371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_f424ab9b66815b153c6e86dfa425adc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 407713,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_25096562a1f3e0608af24f4ef81bf636.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 359208,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_71121a4ffe9d0dca25b7486557d47852.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbce85e-97df-5832-9937-7d228282e156/8cbce85e-97df-5832-9937-7d228282e156_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/2f/6a2f148054823f7992f2932c386b0193/pa/JP82620_2103692d388d147abf6b150f4a870600.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2009}
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [auto1.nl] INFO: Saving data for JP82620: {'created_time': 1774638140.699923, 'last_price_update_time': 1774638140.699957, 'auction_closing_time': 1774713934.0}
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JP82620') HTTP/1.1" 204 0
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-27 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d855dd6-7b15-5f52-a978-90a0880ffa41 with scrape type 1
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg not downloaded yet
2026-03-27 19:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-27 19:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e955c13-67e6-54fd-9208-763665e08e97 with scrape type 1
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e955c13-67e6-54fd-9208-763665e08e97
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_c7d86ee36c47225d159e9d52faa1f631.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_c7d86ee36c47225d159e9d52faa1f631.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_1bb0b7f8e107d7434631ce51140f783d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_1bb0b7f8e107d7434631ce51140f783d.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_052904fa0dacb2491cd65d384f932eb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_052904fa0dacb2491cd65d384f932eb4.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_202b98f7c3269227eda5a242a4db0cbc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_202b98f7c3269227eda5a242a4db0cbc.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_8ea1b8d487d4dcba284b23303204c58e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8ea1b8d487d4dcba284b23303204c58e.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_60e7947b0b3908cf1b333cd0fe0c661d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_60e7947b0b3908cf1b333cd0fe0c661d.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_224d87c1701ed00440256f42e421028d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_224d87c1701ed00440256f42e421028d.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_b57334583aac2c89d602237b5ed09d62.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_b57334583aac2c89d602237b5ed09d62.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_8fd659578ac8baa19ebe73a9bb209abf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8fd659578ac8baa19ebe73a9bb209abf.jpg already downloaded
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe5%252F52e54bf46803f17ff17d6523be02ca0c%252Fpa%252FUV82075_7caa854d2b7ae65e5ba006cbef1c135b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_7caa854d2b7ae65e5ba006cbef1c135b.jpg already downloaded
2026-03-27 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e955c13-67e6-54fd-9208-763665e08e97, identifier: UV82075
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_6aabf8949dacfd01740b2d0b079dc864.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-27 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075
2026-03-27 19:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e955c13-67e6-54fd-9208-763665e08e97 with identifier: UV82075 to the API
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UV82075>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:15Z',
 'fuel_type': 'petrol',
 'id': '1e955c13-67e6-54fd-9208-763665e08e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '1TBT63',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV82075',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 106913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_c7d86ee36c47225d159e9d52faa1f631.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_1bb0b7f8e107d7434631ce51140f783d.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_052904fa0dacb2491cd65d384f932eb4.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_202b98f7c3269227eda5a242a4db0cbc.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8ea1b8d487d4dcba284b23303204c58e.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_60e7947b0b3908cf1b333cd0fe0c661d.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_224d87c1701ed00440256f42e421028d.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_b57334583aac2c89d602237b5ed09d62.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8fd659578ac8baa19ebe73a9bb209abf.jpg',
                'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_7caa854d2b7ae65e5ba006cbef1c135b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_c7d86ee36c47225d159e9d52faa1f631.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_1bb0b7f8e107d7434631ce51140f783d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_052904fa0dacb2491cd65d384f932eb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_202b98f7c3269227eda5a242a4db0cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8ea1b8d487d4dcba284b23303204c58e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2478548,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_60e7947b0b3908cf1b333cd0fe0c661d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2428870,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_224d87c1701ed00440256f42e421028d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_b57334583aac2c89d602237b5ed09d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2462420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_8fd659578ac8baa19ebe73a9bb209abf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e955c13-67e6-54fd-9208-763665e08e97/1e955c13-67e6-54fd-9208-763665e08e97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e5/52e54bf46803f17ff17d6523be02ca0c/pa/UV82075_7caa854d2b7ae65e5ba006cbef1c135b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2014}
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-27 19:02:21 [auto1.nl] INFO: Saving data for UV82075: {'created_time': 1774638141.328508, 'last_price_update_time': 1774638141.328518, 'auction_closing_time': 1774715355.0}
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UV82075') HTTP/1.1" 204 0
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_cc47c74b4043302da09804323c12714d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_b9779259cc54b35a53996e74aaa07807.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_b9779259cc54b35a53996e74aaa07807.jpg not downloaded yet
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_6910f9dcf4da56f3103d233c3f17217a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9d7de290>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F3f%252Fde3fcf9b07f3f79debd53165f8da92df%252Fpa%252FTY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22f201ce-3b7b-5837-b1b0-604b91c7475f
2026-03-27 19:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22f201ce-3b7b-5837-b1b0-604b91c7475f, skipping ID generation
2026-03-27 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f201ce-3b7b-5837-b1b0-604b91c7475f with scrape type 1
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22f201ce-3b7b-5837-b1b0-604b91c7475f sending to next pipeline
2026-03-27 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 22f201ce-3b7b-5837-b1b0-604b91c7475f, identifier: TY02674
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff93210>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_a121049a41595269d124e1200ca5905b.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_a121049a41595269d124e1200ca5905b.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c92be50>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc69810>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_361c38734c5c3cc45d12d68dfe7db363.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_361c38734c5c3cc45d12d68dfe7db363.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341bf896-a01e-5195-90fc-ac4dcc6a334d with identifier: TJ92302
2026-03-27 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341bf896-a01e-5195-90fc-ac4dcc6a334d with scrape type 1
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_6445ae09697dbfc860dad026441001dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_6445ae09697dbfc860dad026441001dd.jpg not downloaded yet
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe69610>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc7ca10>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg saved to cache
2026-03-27 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc87cd0>
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_bec2506339b183f0999146aad47bd200.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg not downloaded yet
2026-03-27 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 22f201ce-3b7b-5837-b1b0-604b91c7475f with identifier: TY02674
2026-03-27 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 22f201ce-3b7b-5837-b1b0-604b91c7475f with identifier: TY02674
2026-03-27 19:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 22f201ce-3b7b-5837-b1b0-604b91c7475f with identifier: TY02674 to the API
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:05Z',
 'fuel_type': 'petrol',
 'id': '22f201ce-3b7b-5837-b1b0-604b91c7475f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7TJS09',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY02674',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 14881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_95f6a7e01dd2bb681ae74d0795b75c7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b4c83551743c5de01bcb25a95be56bfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_f59cb6a7826ec58b60a1dfcf64d1b9c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2170498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_130286151ba13866d4ddd4e532dcfa3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_00afdbcc7f9d8235dc78e3a4b106a83e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_7bb4e97ec56e97f643c281592503f121.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_b0c2a5251c17e3315a871ae647b2ed2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2133117,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_933bd91ec66e3af0b3dd26d885cadb30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2100716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_36ef6ce48d137a1dfbf6a058f6f5a7c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22f201ce-3b7b-5837-b1b0-604b91c7475f/22f201ce-3b7b-5837-b1b0-604b91c7475f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/3f/de3fcf9b07f3f79debd53165f8da92df/pa/TY02674_e884c0d6bba2842b969e3b3a7ba54fcb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY02674%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [auto1.nl] INFO: Saving data for TY02674: {'created_time': 1774638142.432712, 'last_price_update_time': 1774638142.432725, 'auction_closing_time': 1774713905.0}
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TY02674') HTTP/1.1" 204 0
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_90244c7db0fa841f01670ba894462f38.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_4ef4f1a3078062262185682b16e2ea24.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4ef4f1a3078062262185682b16e2ea24.jpg not downloaded yet
2026-03-27 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc7c0d0>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fef5fd0>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_6aabf8949dacfd01740b2d0b079dc864.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_6aabf8949dacfd01740b2d0b079dc864.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_98877960e0c2a89ea04bac9b3999d562.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg not downloaded yet
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_14b32750aa36ad1f854559a27624cf68.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_3d910de5afd00be78ff2c7400d51d87f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg not downloaded yet
2026-03-27 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc41190>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_cc47c74b4043302da09804323c12714d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_cc47c74b4043302da09804323c12714d.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc7ead0>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb44550>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9d67d0>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_6910f9dcf4da56f3103d233c3f17217a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_6910f9dcf4da56f3103d233c3f17217a.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c999650>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_bec2506339b183f0999146aad47bd200.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_bec2506339b183f0999146aad47bd200.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg not downloaded yet
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff5ccd0>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_90244c7db0fa841f01670ba894462f38.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_90244c7db0fa841f01670ba894462f38.jpg saved to cache
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg not downloaded yet
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_6445ae09697dbfc860dad026441001dd.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_d4cdad2f61c6d9383e58d1703e916420.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_d4cdad2f61c6d9383e58d1703e916420.jpg not downloaded yet
2026-03-27 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG47676> (referer: https://www.auto1.com/v1/car-details-view/UG47676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff5ea50>
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb7%252F8f%252Fb78f7e8c1fb11e9cd09a7500dff92796%252Fpa%252FML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg saved to cache
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e
2026-03-27 19:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e, skipping ID generation
2026-03-27 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with scrape type 1
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3cb501d5-6e9e-578c-a21d-18164b4c2f0e sending to next pipeline
2026-03-27 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e, identifier: ML76723
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc84d90>
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_98877960e0c2a89ea04bac9b3999d562.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_98877960e0c2a89ea04bac9b3999d562.jpg saved to cache
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cc410>
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252Fb7%252F14b73af61815154fc043a5c2eee9c4d5%252Fpa%252FGY00070_14b32750aa36ad1f854559a27624cf68.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_14b32750aa36ad1f854559a27624cf68.jpg saved to cache
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dfe957d-07da-58b3-b64d-f237cbadc483
2026-03-27 19:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dfe957d-07da-58b3-b64d-f237cbadc483, skipping ID generation
2026-03-27 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfe957d-07da-58b3-b64d-f237cbadc483 with scrape type 1
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dfe957d-07da-58b3-b64d-f237cbadc483 sending to next pipeline
2026-03-27 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dfe957d-07da-58b3-b64d-f237cbadc483, identifier: GY00070
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb3f910>
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252Fed%252F5ded79f328daaa469821687ca5f08b36%252Fpa%252FDD65196_3d910de5afd00be78ff2c7400d51d87f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_3d910de5afd00be78ff2c7400d51d87f.jpg saved to cache
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item beeb97f8-8f52-56aa-9079-b6f8934586d5
2026-03-27 19:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: beeb97f8-8f52-56aa-9079-b6f8934586d5, skipping ID generation
2026-03-27 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beeb97f8-8f52-56aa-9079-b6f8934586d5 with scrape type 1
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item beeb97f8-8f52-56aa-9079-b6f8934586d5 sending to next pipeline
2026-03-27 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: beeb97f8-8f52-56aa-9079-b6f8934586d5, identifier: DD65196
2026-03-27 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_28df5dd13a69c11251d83994801b5115.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_28df5dd13a69c11251d83994801b5115.jpg not downloaded yet
2026-03-27 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-27 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723
2026-03-27 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3cb501d5-6e9e-578c-a21d-18164b4c2f0e with identifier: ML76723 to the API
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': '3cb501d5-6e9e-578c-a21d-18164b4c2f0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '10NPX2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML76723',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 208462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_56f2a6d3d6f0ad60ffe215e9d2c853f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_94f2241e6715440a813763c4e8976ba6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f99d34997c1a4a6ab7aab95e0726414d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_6aabf8949dacfd01740b2d0b079dc864.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cb501d5-6e9e-578c-a21d-18164b4c2f0e/3cb501d5-6e9e-578c-a21d-18164b4c2f0e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb7/8f/b78f7e8c1fb11e9cd09a7500dff92796/pa/ML76723_f8a14cfe430f6c8bfd4e74638fdf7b8e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo MultiAir T. Emotion',
 'transmission': 'manual',
 'trim': 'MultiAir T. Emotion',
 'year': 2010}
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-27 19:02:23 [auto1.nl] INFO: Saving data for ML76723: {'created_time': 1774638143.772368, 'last_price_update_time': 1774638143.77238, 'auction_closing_time': 1774714609.0}
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ML76723') HTTP/1.1" 204 0
2026-03-27 19:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-27 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070
2026-03-27 19:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dfe957d-07da-58b3-b64d-f237cbadc483 with identifier: GY00070 to the API
2026-03-27 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_14b32750aa36ad1f854559a27624cf68.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'petrol',
 'id': '2dfe957d-07da-58b3-b64d-f237cbadc483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '23XFJR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY00070',
 'listing': 'auction',
 'location': 'NL, Amstelveen',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 156020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_14b32750aa36ad1f854559a27624cf68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_98877960e0c2a89ea04bac9b3999d562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_9f78cc7f96175cc4e192ad06299b9bf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_6910f9dcf4da56f3103d233c3f17217a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfe957d-07da-58b3-b64d-f237cbadc483/2dfe957d-07da-58b3-b64d-f237cbadc483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/b7/14b73af61815154fc043a5c2eee9c4d5/pa/GY00070_bb0bef92a6801c4fc13a98cfc4987fad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Inform',
 'transmission': 'automatic',
 'trim': 'Inform',
 'year': 2007}
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [auto1.nl] INFO: Saving data for GY00070: {'created_time': 1774638144.128975, 'last_price_update_time': 1774638144.128986, 'auction_closing_time': 1774714568.0}
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY00070') HTTP/1.1" 204 0
2026-03-27 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-27 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196
2026-03-27 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: beeb97f8-8f52-56aa-9079-b6f8934586d5 with identifier: DD65196 to the API
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_3d910de5afd00be78ff2c7400d51d87f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:15:07Z',
 'fuel_type': 'petrol',
 'id': 'beeb97f8-8f52-56aa-9079-b6f8934586d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '77RKKJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD65196',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'BMW',
 'model': '1er',
 'odometer': 256696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_3d910de5afd00be78ff2c7400d51d87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_de3d58fb06bdac2814fb2d96e7f39355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_361c38734c5c3cc45d12d68dfe7db363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_8bc4c8b57a44cff4ad70fb392b0a1281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beeb97f8-8f52-56aa-9079-b6f8934586d5/beeb97f8-8f52-56aa-9079-b6f8934586d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/ed/5ded79f328daaa469821687ca5f08b36/pa/DD65196_bec2506339b183f0999146aad47bd200.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [auto1.nl] INFO: Saving data for DD65196: {'created_time': 1774638144.475591, 'last_price_update_time': 1774638144.475602, 'auction_closing_time': 1774714507.0}
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DD65196') HTTP/1.1" 204 0
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4ef4f1a3078062262185682b16e2ea24.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_154f36de9e84a54aa5583c4d823afe97.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_154f36de9e84a54aa5583c4d823afe97.jpg not downloaded yet
2026-03-27 19:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_b9779259cc54b35a53996e74aaa07807.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_0982d077af5a4627a9004b6c1e927074.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_0982d077af5a4627a9004b6c1e927074.jpg not downloaded yet
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY79842> (referer: https://www.auto1.com/v1/car-details-view/NY79842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD83498> (referer: https://www.auto1.com/v1/car-details-view/GD83498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9caaddd0>
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg saved to cache
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9e8bd3d0>
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_6445ae09697dbfc860dad026441001dd.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_6445ae09697dbfc860dad026441001dd.jpg saved to cache
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e4d006d-0ad1-5150-a018-87888e87e5fa with identifier: UG47676
2026-03-27 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e4d006d-0ad1-5150-a018-87888e87e5fa with scrape type 1
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2e4d006d-0ad1-5150-a018-87888e87e5fa
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F87%252F7e87a4ff95505903f3c98f9ea7b37014%252Fpa%252FUG47676_a965f0cc771407e7761a590e94c822b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_a965f0cc771407e7761a590e94c822b7.jpg already downloaded
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F87%252F7e87a4ff95505903f3c98f9ea7b37014%252Fpa%252FUG47676_2b31efe015fa5e1b5418f26bbfb19822.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_2b31efe015fa5e1b5418f26bbfb19822.jpg already downloaded
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F87%252F7e87a4ff95505903f3c98f9ea7b37014%252Fpa%252FUG47676_8bc175572c39a8b39baeed228aab539d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_8bc175572c39a8b39baeed228aab539d.jpg already downloaded
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F87%252F7e87a4ff95505903f3c98f9ea7b37014%252Fpa%252FUG47676_aad91488b932776c67a541d9ec270297.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_aad91488b932776c67a541d9ec270297.jpg already downloaded
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F87%252F7e87a4ff95505903f3c98f9ea7b37014%252Fpa%252FUG47676_c4d4d5311bc925cf302fe5c994f3a19d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_c4d4d5311bc925cf302fe5c994f3a19d.jpg already downloaded
2026-03-27 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e4d006d-0ad1-5150-a018-87888e87e5fa, identifier: UG47676
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_2eb49297b440f5af4566671f953f3b07.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_2eb49297b440f5af4566671f953f3b07.jpg not downloaded yet
2026-03-27 19:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF88410> (referer: https://www.auto1.com/v1/car-details-view/TF88410/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e4d006d-0ad1-5150-a018-87888e87e5fa with identifier: UG47676
2026-03-27 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e4d006d-0ad1-5150-a018-87888e87e5fa with identifier: UG47676
2026-03-27 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e4d006d-0ad1-5150-a018-87888e87e5fa with identifier: UG47676 to the API
2026-03-27 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG47676>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:56:58Z',
 'fuel_type': 'diesel',
 'id': '2e4d006d-0ad1-5150-a018-87888e87e5fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '87VRV3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG47676',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 390116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_a965f0cc771407e7761a590e94c822b7.jpg',
                'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_2b31efe015fa5e1b5418f26bbfb19822.jpg',
                'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_8bc175572c39a8b39baeed228aab539d.jpg',
                'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_aad91488b932776c67a541d9ec270297.jpg',
                'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_c4d4d5311bc925cf302fe5c994f3a19d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4d006d-0ad1-5150-a018-87888e87e5fa/2e4d006d-0ad1-5150-a018-87888e87e5fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_a965f0cc771407e7761a590e94c822b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4d006d-0ad1-5150-a018-87888e87e5fa/2e4d006d-0ad1-5150-a018-87888e87e5fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_2b31efe015fa5e1b5418f26bbfb19822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4d006d-0ad1-5150-a018-87888e87e5fa/2e4d006d-0ad1-5150-a018-87888e87e5fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_8bc175572c39a8b39baeed228aab539d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4d006d-0ad1-5150-a018-87888e87e5fa/2e4d006d-0ad1-5150-a018-87888e87e5fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_aad91488b932776c67a541d9ec270297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e4d006d-0ad1-5150-a018-87888e87e5fa/2e4d006d-0ad1-5150-a018-87888e87e5fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/87/7e87a4ff95505903f3c98f9ea7b37014/pa/UG47676_c4d4d5311bc925cf302fe5c994f3a19d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-06-21',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [auto1.nl] INFO: Saving data for UG47676: {'created_time': 1774638145.164991, 'last_price_update_time': 1774638145.165002, 'auction_closing_time': 1774717018.0}
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG47676') HTTP/1.1" 204 0
2026-03-27 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff87c90>
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg saved to cache
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_bcba44e5760508648cf0fa7271595b29.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_bcba44e5760508648cf0fa7271595b29.jpg not downloaded yet
2026-03-27 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_d4cdad2f61c6d9383e58d1703e916420.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_39e98d10c0535fa889515248579f908d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_39e98d10c0535fa889515248579f908d.jpg not downloaded yet
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR88481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd3d950>
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_4ef4f1a3078062262185682b16e2ea24.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4ef4f1a3078062262185682b16e2ea24.jpg saved to cache
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c918050>
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg saved to cache
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbf20d0>
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_b9779259cc54b35a53996e74aaa07807.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_b9779259cc54b35a53996e74aaa07807.jpg saved to cache
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 820fa3f1-313d-5563-a830-5d53691f05b1 with identifier: NY79842
2026-03-27 19:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 820fa3f1-313d-5563-a830-5d53691f05b1 with scrape type 1
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 820fa3f1-313d-5563-a830-5d53691f05b1
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_f648fc718316db156d4fba3efcb62682.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_f648fc718316db156d4fba3efcb62682.jpg not downloaded yet
2026-03-27 19:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-27 19:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbe91c26-603b-5808-9c76-54017d2a9327 with scrape type 1
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fbe91c26-603b-5808-9c76-54017d2a9327
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71205feb1c5735c717a886ead8a77a01%252Fpa%252FGD83498_1832c57242e082571dec969e0be354c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_1832c57242e082571dec969e0be354c1.jpg already downloaded
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71205feb1c5735c717a886ead8a77a01%252Fpa%252FGD83498_48c6281fa43e0e77d74cf2a169424bcb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_48c6281fa43e0e77d74cf2a169424bcb.jpg already downloaded
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71205feb1c5735c717a886ead8a77a01%252Fpa%252FGD83498_f29cf5a62119ebcc39d209f241810d94.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_f29cf5a62119ebcc39d209f241810d94.jpg already downloaded
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71205feb1c5735c717a886ead8a77a01%252Fpa%252FGD83498_a1aaa15b123fd1e450e93a47aa585156.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_a1aaa15b123fd1e450e93a47aa585156.jpg already downloaded
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71205feb1c5735c717a886ead8a77a01%252Fpa%252FGD83498_bb3031c18945efeb3fad09ff554d7c9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_bb3031c18945efeb3fad09ff554d7c9a.jpg already downloaded
2026-03-27 19:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fbe91c26-603b-5808-9c76-54017d2a9327, identifier: GD83498
2026-03-27 19:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_006ae6c78562459d939a37ae2088be8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_8317d3824472e6498fc7a58211f0b122.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_8317d3824472e6498fc7a58211f0b122.jpg not downloaded yet
2026-03-27 19:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-27 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498
2026-03-27 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fbe91c26-603b-5808-9c76-54017d2a9327 with identifier: GD83498 to the API
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD83498>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:11Z',
 'fuel_type': 'diesel',
 'id': 'fbe91c26-603b-5808-9c76-54017d2a9327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4KLL98',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD83498',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 261007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_1832c57242e082571dec969e0be354c1.jpg',
                'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_48c6281fa43e0e77d74cf2a169424bcb.jpg',
                'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_f29cf5a62119ebcc39d209f241810d94.jpg',
                'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_a1aaa15b123fd1e450e93a47aa585156.jpg',
                'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_bb3031c18945efeb3fad09ff554d7c9a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe91c26-603b-5808-9c76-54017d2a9327/fbe91c26-603b-5808-9c76-54017d2a9327_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_1832c57242e082571dec969e0be354c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe91c26-603b-5808-9c76-54017d2a9327/fbe91c26-603b-5808-9c76-54017d2a9327_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_48c6281fa43e0e77d74cf2a169424bcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe91c26-603b-5808-9c76-54017d2a9327/fbe91c26-603b-5808-9c76-54017d2a9327_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_f29cf5a62119ebcc39d209f241810d94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe91c26-603b-5808-9c76-54017d2a9327/fbe91c26-603b-5808-9c76-54017d2a9327_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_a1aaa15b123fd1e450e93a47aa585156.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbe91c26-603b-5808-9c76-54017d2a9327/fbe91c26-603b-5808-9c76-54017d2a9327_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71205feb1c5735c717a886ead8a77a01/pa/GD83498_bb3031c18945efeb3fad09ff554d7c9a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2013}
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-27 19:02:25 [auto1.nl] INFO: Saving data for GD83498: {'created_time': 1774638145.971989, 'last_price_update_time': 1774638145.972002, 'auction_closing_time': 1774716011.0}
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD83498') HTTP/1.1" 204 0
2026-03-27 19:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: deb65919-2a49-55f4-b3a3-0dd577869406 with identifier: TF88410
2026-03-27 19:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item deb65919-2a49-55f4-b3a3-0dd577869406 with scrape type 1
2026-03-27 19:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item deb65919-2a49-55f4-b3a3-0dd577869406
2026-03-27 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_0606cc7d635d144eb3ffbfb2c91e1dd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_0606cc7d635d144eb3ffbfb2c91e1dd3.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_dddc7de2f4505308335444da4822db3f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_dddc7de2f4505308335444da4822db3f.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_16f9e6bb387f13fa2fd5b89f73ccde4f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_16f9e6bb387f13fa2fd5b89f73ccde4f.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_8972689452f3c50d89e3845d44cf586b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_8972689452f3c50d89e3845d44cf586b.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_c918a49fb15846d35993c09ec2e644ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c918a49fb15846d35993c09ec2e644ba.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_71cc201cee9ff7daa7060559a51cee59.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_71cc201cee9ff7daa7060559a51cee59.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_47fce494accbd6ee8314762139f4b1a4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_47fce494accbd6ee8314762139f4b1a4.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_81cdf58ce2b0a1a2a39a13d4766acfa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_81cdf58ce2b0a1a2a39a13d4766acfa6.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_fde64d89161607a86e74570c10fe80a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_fde64d89161607a86e74570c10fe80a1.jpg already downloaded
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F30%252Fdb30f6d36b2310d76da7539fb04f0857%252Fpa%252FTF88410_c06796dfb745181147722c22ade40fe3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c06796dfb745181147722c22ade40fe3.jpg already downloaded
2026-03-27 19:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: deb65919-2a49-55f4-b3a3-0dd577869406, identifier: TF88410
2026-03-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_154f36de9e84a54aa5583c4d823afe97.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_28df5dd13a69c11251d83994801b5115.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg not downloaded yet
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_c080868af5e1b8ee204593713bdcead4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_c080868af5e1b8ee204593713bdcead4.jpg not downloaded yet
2026-03-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ86590> (referer: https://www.auto1.com/v1/car-details-view/VJ86590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: deb65919-2a49-55f4-b3a3-0dd577869406 with identifier: TF88410
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 19:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: deb65919-2a49-55f4-b3a3-0dd577869406 with identifier: TF88410
2026-03-27 19:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: deb65919-2a49-55f4-b3a3-0dd577869406 with identifier: TF88410 to the API
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF88410>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 317,
 'expiration_date': '2026-03-28T16:51:24Z',
 'fuel_type': 'petrol',
 'id': 'deb65919-2a49-55f4-b3a3-0dd577869406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'R281HN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF88410',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 127281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_0606cc7d635d144eb3ffbfb2c91e1dd3.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_dddc7de2f4505308335444da4822db3f.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_16f9e6bb387f13fa2fd5b89f73ccde4f.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_8972689452f3c50d89e3845d44cf586b.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c918a49fb15846d35993c09ec2e644ba.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_71cc201cee9ff7daa7060559a51cee59.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_47fce494accbd6ee8314762139f4b1a4.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_81cdf58ce2b0a1a2a39a13d4766acfa6.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_fde64d89161607a86e74570c10fe80a1.jpg',
                'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c06796dfb745181147722c22ade40fe3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_0606cc7d635d144eb3ffbfb2c91e1dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_dddc7de2f4505308335444da4822db3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_16f9e6bb387f13fa2fd5b89f73ccde4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_8972689452f3c50d89e3845d44cf586b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c918a49fb15846d35993c09ec2e644ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_71cc201cee9ff7daa7060559a51cee59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_47fce494accbd6ee8314762139f4b1a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_81cdf58ce2b0a1a2a39a13d4766acfa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_fde64d89161607a86e74570c10fe80a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_deb65919-2a49-55f4-b3a3-0dd577869406/deb65919-2a49-55f4-b3a3-0dd577869406_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/30/db30f6d36b2310d76da7539fb04f0857/pa/TF88410_c06796dfb745181147722c22ade40fe3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Mustang 2.3 EcoBoost Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2017}
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF88410%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [auto1.nl] INFO: Saving data for TF88410: {'created_time': 1774638146.722829, 'last_price_update_time': 1774638146.72284, 'auction_closing_time': 1774716684.0}
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF88410') HTTP/1.1" 204 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg not downloaded yet
2026-03-27 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN92622> (referer: https://www.auto1.com/v1/car-details-view/TN92622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc7c8d0>
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg saved to cache
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca717d0>
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg saved to cache
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda6410>
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg saved to cache
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c976290>
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_d4cdad2f61c6d9383e58d1703e916420.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_d4cdad2f61c6d9383e58d1703e916420.jpg saved to cache
2026-03-27 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff46190>
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_0982d077af5a4627a9004b6c1e927074.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_3cccc5473be56f84bcc0881b3160c004.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_746ab1e9050ee60f3738682f06529dd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_746ab1e9050ee60f3738682f06529dd8.jpg not downloaded yet
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_2eb49297b440f5af4566671f953f3b07.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_4650b728777248d611bf277bf760540f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4650b728777248d611bf277bf760540f.jpg not downloaded yet
2026-03-27 19:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe86590>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb9%252Fadb96ddfd61cd295da0e9d7602087cfa%252Fpa%252FRF39867_006ae6c78562459d939a37ae2088be8f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_006ae6c78562459d939a37ae2088be8f.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07
2026-03-27 19:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07, skipping ID generation
2026-03-27 19:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with scrape type 1
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 sending to next pipeline
2026-03-27 19:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07, identifier: RF39867
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8d6c50>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_154f36de9e84a54aa5583c4d823afe97.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_154f36de9e84a54aa5583c4d823afe97.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbe5790>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_28df5dd13a69c11251d83994801b5115.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_28df5dd13a69c11251d83994801b5115.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-27 19:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450b030e-a049-531c-a7a0-9d8cd0757cf2 with scrape type 1
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg not downloaded yet
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_bcba44e5760508648cf0fa7271595b29.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_054f9f3ed89537b9e51c69d833cabd81.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_054f9f3ed89537b9e51c69d833cabd81.jpg not downloaded yet
2026-03-27 19:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-27 19:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867
2026-03-27 19:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56a21b27-cfc0-5a40-99b1-3ec63ac21b07 with identifier: RF39867 to the API
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_006ae6c78562459d939a37ae2088be8f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:18Z',
 'fuel_type': 'petrol',
 'id': '56a21b27-cfc0-5a40-99b1-3ec63ac21b07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF39867',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 77053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_0f214e7086a9c27db7674f32ea4890b0.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_e004006f786b7190eaed30e8ee8a9481.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 700467,
             'Height': 2048,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_fbdc6eac81dada43e6dccd0d41de074f.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 451487,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_a121049a41595269d124e1200ca5905b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 690569,
             'Height': 2048,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_cc47c74b4043302da09804323c12714d.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 552311,
             'Height': 2048,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_006ae6c78562459d939a37ae2088be8f.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_d2ecd9b5167ef413fc48daeab8fea814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_6e3871cd02ab2a614a609ffcdaa5caa2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 856787,
             'Height': 2048,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_03966c12cc4f3d1fe32ae4cd8cd291c0.jpg',
             'Width': 1536},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56a21b27-cfc0-5a40-99b1-3ec63ac21b07/56a21b27-cfc0-5a40-99b1-3ec63ac21b07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b9/adb96ddfd61cd295da0e9d7602087cfa/pa/RF39867_90244c7db0fa841f01670ba894462f38.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [auto1.nl] INFO: Saving data for RF39867: {'created_time': 1774638147.717467, 'last_price_update_time': 1774638147.717478, 'auction_closing_time': 1774715178.0}
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF39867') HTTP/1.1" 204 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_ae096f428cddbca82a7451bf9712e63d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_ae096f428cddbca82a7451bf9712e63d.jpg not downloaded yet
2026-03-27 19:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-27 19:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with scrape type 1
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg not downloaded yet
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_f648fc718316db156d4fba3efcb62682.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_39e98d10c0535fa889515248579f908d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c90dad0>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_0982d077af5a4627a9004b6c1e927074.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_0982d077af5a4627a9004b6c1e927074.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c91af50>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_3cccc5473be56f84bcc0881b3160c004.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_3cccc5473be56f84bcc0881b3160c004.jpg saved to cache
2026-03-27 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c932490>
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca83f50>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_2eb49297b440f5af4566671f953f3b07.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_2eb49297b440f5af4566671f953f3b07.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_8317d3824472e6498fc7a58211f0b122.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_56543d9f7a771a715ed505aba054671a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_56543d9f7a771a715ed505aba054671a.jpg not downloaded yet
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg not downloaded yet
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH96879/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc0a210>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_bcba44e5760508648cf0fa7271595b29.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_bcba44e5760508648cf0fa7271595b29.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_c080868af5e1b8ee204593713bdcead4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_813d5a322790ddccf9632be798d8c1de.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_813d5a322790ddccf9632be798d8c1de.jpg not downloaded yet
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg not downloaded yet
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD56346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca1d650>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_f648fc718316db156d4fba3efcb62682.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_f648fc718316db156d4fba3efcb62682.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 820fa3f1-313d-5563-a830-5d53691f05b1
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe75350>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_39e98d10c0535fa889515248579f908d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_39e98d10c0535fa889515248579f908d.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_746ab1e9050ee60f3738682f06529dd8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC22580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_40f93a377aa4042b9b422286cc9a44da.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_40f93a377aa4042b9b422286cc9a44da.jpg not downloaded yet
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg not downloaded yet
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_054f9f3ed89537b9e51c69d833cabd81.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UD40907/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9d7de310>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_8317d3824472e6498fc7a58211f0b122.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_8317d3824472e6498fc7a58211f0b122.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ec10590>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_c080868af5e1b8ee204593713bdcead4.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_c080868af5e1b8ee204593713bdcead4.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 820fa3f1-313d-5563-a830-5d53691f05b1
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8c9610>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe8%252F87e86c40db7c6d39722d8b3878308960%252Fpa%252FXY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg saved to cache
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d855dd6-7b15-5f52-a978-90a0880ffa41
2026-03-27 19:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d855dd6-7b15-5f52-a978-90a0880ffa41, skipping ID generation
2026-03-27 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d855dd6-7b15-5f52-a978-90a0880ffa41 with scrape type 1
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d855dd6-7b15-5f52-a978-90a0880ffa41 sending to next pipeline
2026-03-27 19:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5d855dd6-7b15-5f52-a978-90a0880ffa41, identifier: XY26028
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg not downloaded yet
2026-03-27 19:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-27 19:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028
2026-03-27 19:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5d855dd6-7b15-5f52-a978-90a0880ffa41 with identifier: XY26028 to the API
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:13Z',
 'fuel_type': 'petrol',
 'id': '5d855dd6-7b15-5f52-a978-90a0880ffa41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7-XFV-00',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY26028',
 'listing': 'auction',
 'location': 'NL, Echt',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 288528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_cbc9477c2f0d7a9a088de31c8fca3024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_b9779259cc54b35a53996e74aaa07807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_46f3eb56af5eaa3746f4470ae55c64e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_0d5f59f9b36b00a1e7ce094ace5da566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_c86791ae71ee51ad59d48c0ca8aea90f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_d4cdad2f61c6d9383e58d1703e916420.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_154f36de9e84a54aa5583c4d823afe97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_2eb49297b440f5af4566671f953f3b07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_39e98d10c0535fa889515248579f908d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d855dd6-7b15-5f52-a978-90a0880ffa41/5d855dd6-7b15-5f52-a978-90a0880ffa41_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e8/87e86c40db7c6d39722d8b3878308960/pa/XY26028_26b66120aad34b8bf07e5b786b92cdc3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-27 19:02:28 [auto1.nl] INFO: Saving data for XY26028: {'created_time': 1774638148.948817, 'last_price_update_time': 1774638148.948829, 'auction_closing_time': 1774714273.0}
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY26028') HTTP/1.1" 204 0
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4650b728777248d611bf277bf760540f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_ae096f428cddbca82a7451bf9712e63d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd2ce50>
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_746ab1e9050ee60f3738682f06529dd8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_746ab1e9050ee60f3738682f06529dd8.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 820fa3f1-313d-5563-a830-5d53691f05b1
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffc8f90>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca53190>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F5e%252Fd25e43cabc1b0db03ad9e29a5979c1e7%252Fpa%252FNY79842_054f9f3ed89537b9e51c69d833cabd81.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_054f9f3ed89537b9e51c69d833cabd81.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 820fa3f1-313d-5563-a830-5d53691f05b1
2026-03-27 19:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 820fa3f1-313d-5563-a830-5d53691f05b1, skipping ID generation
2026-03-27 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 820fa3f1-313d-5563-a830-5d53691f05b1 with scrape type 1
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 820fa3f1-313d-5563-a830-5d53691f05b1 sending to next pipeline
2026-03-27 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 820fa3f1-313d-5563-a830-5d53691f05b1, identifier: NY79842
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9199d0>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_718dfd9a302893ca51754a3d13e3aad3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_56543d9f7a771a715ed505aba054671a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 820fa3f1-313d-5563-a830-5d53691f05b1 with identifier: NY79842
2026-03-27 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 820fa3f1-313d-5563-a830-5d53691f05b1 with identifier: NY79842
2026-03-27 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 820fa3f1-313d-5563-a830-5d53691f05b1 with identifier: NY79842 to the API
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_054f9f3ed89537b9e51c69d833cabd81.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:39:49Z',
 'fuel_type': 'petrol',
 'id': '820fa3f1-313d-5563-a830-5d53691f05b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JF202B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY79842',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 187443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_f648fc718316db156d4fba3efcb62682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_c080868af5e1b8ee204593713bdcead4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_746ab1e9050ee60f3738682f06529dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_820fa3f1-313d-5563-a830-5d53691f05b1/820fa3f1-313d-5563-a830-5d53691f05b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/5e/d25e43cabc1b0db03ad9e29a5979c1e7/pa/NY79842_054f9f3ed89537b9e51c69d833cabd81.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2008}
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY79842%27 HTTP/1.1" 200 None
2026-03-27 19:02:29 [auto1.nl] INFO: Saving data for NY79842: {'created_time': 1774638149.683777, 'last_price_update_time': 1774638149.683788, 'auction_closing_time': 1774715989.0}
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY79842') HTTP/1.1" 204 0
2026-03-27 19:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca31bd0>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_4650b728777248d611bf277bf760540f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4650b728777248d611bf277bf760540f.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c94bc10>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_ae096f428cddbca82a7451bf9712e63d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_ae096f428cddbca82a7451bf9712e63d.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbe4c50>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_813d5a322790ddccf9632be798d8c1de.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE05380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda1b90>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252Fa0%252Ffaa00233a7e21240cbb6ecfd81f525c1%252Fpa%252FAL57491_718dfd9a302893ca51754a3d13e3aad3.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_718dfd9a302893ca51754a3d13e3aad3.jpg saved to cache
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39141fa5-6e43-5c84-aaab-2419efc17585
2026-03-27 19:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39141fa5-6e43-5c84-aaab-2419efc17585, skipping ID generation
2026-03-27 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39141fa5-6e43-5c84-aaab-2419efc17585 with scrape type 1
2026-03-27 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39141fa5-6e43-5c84-aaab-2419efc17585 sending to next pipeline
2026-03-27 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 39141fa5-6e43-5c84-aaab-2419efc17585, identifier: AL57491
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda1390>
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_56543d9f7a771a715ed505aba054671a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_56543d9f7a771a715ed505aba054671a.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_40f93a377aa4042b9b422286cc9a44da.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR88481> (referer: https://www.auto1.com/v1/car-details-view/HR88481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-27 19:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491
2026-03-27 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 39141fa5-6e43-5c84-aaab-2419efc17585 with identifier: AL57491 to the API
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_718dfd9a302893ca51754a3d13e3aad3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:17:07Z',
 'fuel_type': 'petrol',
 'id': '39141fa5-6e43-5c84-aaab-2419efc17585',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6TSL43',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL57491',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 200297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75396,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_718dfd9a302893ca51754a3d13e3aad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9ebe72357025ad3826f3dfc6ef8ba56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76151,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_3cccc5473be56f84bcc0881b3160c004.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_96e78bb30ced504ca18d3a7c052f84b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39141fa5-6e43-5c84-aaab-2419efc17585/39141fa5-6e43-5c84-aaab-2419efc17585_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/a0/faa00233a7e21240cbb6ecfd81f525c1/pa/AL57491_d9667633295da188d4a4c1fe76a70b53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-27 19:02:30 [auto1.nl] INFO: Saving data for AL57491: {'created_time': 1774638150.321564, 'last_price_update_time': 1774638150.321574, 'auction_closing_time': 1774714627.0}
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL57491') HTTP/1.1" 204 0
2026-03-27 19:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe88b50>
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ec0df10>
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fea7c10>
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_813d5a322790ddccf9632be798d8c1de.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_813d5a322790ddccf9632be798d8c1de.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG63197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV54622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe59510>
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252Fe9%252F3ae9d1e35d01c7f56b8ae6d8f7a4ddef%252Fpa%252FBN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ebbc78c-5f24-54dc-a529-fab497851a5f
2026-03-27 19:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ebbc78c-5f24-54dc-a529-fab497851a5f, skipping ID generation
2026-03-27 19:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 1
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ebbc78c-5f24-54dc-a529-fab497851a5f sending to next pipeline
2026-03-27 19:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ebbc78c-5f24-54dc-a529-fab497851a5f, identifier: BN75332
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8c7090>
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F29%252Fe629a6b2272ca37509aaf73a54ef2bbb%252Fpa%252FVJ86590_40f93a377aa4042b9b422286cc9a44da.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_40f93a377aa4042b9b422286cc9a44da.jpg saved to cache
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 450b030e-a049-531c-a7a0-9d8cd0757cf2
2026-03-27 19:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 450b030e-a049-531c-a7a0-9d8cd0757cf2, skipping ID generation
2026-03-27 19:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450b030e-a049-531c-a7a0-9d8cd0757cf2 with scrape type 1
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 450b030e-a049-531c-a7a0-9d8cd0757cf2 sending to next pipeline
2026-03-27 19:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 450b030e-a049-531c-a7a0-9d8cd0757cf2, identifier: VJ86590
2026-03-27 19:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-27 19:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e81360d-d5fc-56b3-826b-ddc4e5870425 with scrape type 1
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg not downloaded yet
2026-03-27 19:02:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-27 19:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-27 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332 to the API
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:17:40Z',
 'fuel_type': 'petrol',
 'id': '4ebbc78c-5f24-54dc-a529-fab497851a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PX549N',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN75332',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '1er',
 'odometer': 279342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a8c996803cf4ca3a5a25a63f93cba241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_a037d3bdc94f1926d0de22ad7ba3e485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_54cecc36803082a834f8db4bc69aad55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_e5fdccb907fb82902ead57998b1d255f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_ba0f7094cd9aab6ae2d629ad1129c675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ebbc78c-5f24-54dc-a529-fab497851a5f/4ebbc78c-5f24-54dc-a529-fab497851a5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/e9/3ae9d1e35d01c7f56b8ae6d8f7a4ddef/pa/BN75332_175269ca1cea5830733c4415ed83782a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-27 19:02:31 [auto1.nl] INFO: Saving data for BN75332: {'created_time': 1774638151.099448, 'last_price_update_time': 1774638151.099458, 'auction_closing_time': 1774714660.0}
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN75332') HTTP/1.1" 204 0
2026-03-27 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-27 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590
2026-03-27 19:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 450b030e-a049-531c-a7a0-9d8cd0757cf2 with identifier: VJ86590 to the API
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_40f93a377aa4042b9b422286cc9a44da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:18Z',
 'fuel_type': 'petrol',
 'id': '450b030e-a049-531c-a7a0-9d8cd0757cf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '15LVG5',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ86590',
 'listing': 'auction',
 'location': 'NL, Tilburg',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 200383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_16142fdfeddaa51f9802884d9fd0635c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_ae096f428cddbca82a7451bf9712e63d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_56543d9f7a771a715ed505aba054671a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_813d5a322790ddccf9632be798d8c1de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_450b030e-a049-531c-a7a0-9d8cd0757cf2/450b030e-a049-531c-a7a0-9d8cd0757cf2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/29/e629a6b2272ca37509aaf73a54ef2bbb/pa/VJ86590_40f93a377aa4042b9b422286cc9a44da.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2010}
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-27 19:02:31 [auto1.nl] INFO: Saving data for VJ86590: {'created_time': 1774638151.550385, 'last_price_update_time': 1774638151.550395, 'auction_closing_time': 1774715418.0}
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ86590') HTTP/1.1" 204 0
2026-03-27 19:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe54510>
2026-03-27 19:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252F44%252Fac44ae1036b46a5d1a419aa4704b1c98%252Fpa%252FTN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg saved to cache
2026-03-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d
2026-03-27 19:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d, skipping ID generation
2026-03-27 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with scrape type 1
2026-03-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 686ec9ee-17b2-5b45-91b2-6db66bb98e5d sending to next pipeline
2026-03-27 19:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d, identifier: TN92622
2026-03-27 19:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_0baad28eb0651abe63f32ffbc55ed318.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_0baad28eb0651abe63f32ffbc55ed318.jpg not downloaded yet
2026-03-27 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-27 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622
2026-03-27 19:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 686ec9ee-17b2-5b45-91b2-6db66bb98e5d with identifier: TN92622 to the API
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:44:58Z',
 'fuel_type': 'petrol',
 'id': '686ec9ee-17b2-5b45-91b2-6db66bb98e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '11-RRT-9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN92622',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Mazda',
 'model': '3',
 'odometer': 250599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5a796d21fd3293d92e5d0acb23dae4d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_a46d000af8e2c3bb79560bfbcf4e318e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_5742624731df7e5bd5f6a4c3a7ee80c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_d54be2ca9974c6a7fb1da02d26702f8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686ec9ee-17b2-5b45-91b2-6db66bb98e5d/686ec9ee-17b2-5b45-91b2-6db66bb98e5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/44/ac44ae1036b46a5d1a419aa4704b1c98/pa/TN92622_98e3adf904b05b6e3f1a1ba4b9e4f9ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 1.6 Edition 125',
 'transmission': 'manual',
 'trim': 'Edition 125',
 'year': 2011}
2026-03-27 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [auto1.nl] INFO: Saving data for TN92622: {'created_time': 1774638152.002719, 'last_price_update_time': 1774638152.00273, 'auction_closing_time': 1774716298.0}
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TN92622') HTTP/1.1" 204 0
2026-03-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD40907> (referer: https://www.auto1.com/v1/car-details-view/UD40907/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:32 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 916 | hits on page: 40
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg not downloaded yet
2026-03-27 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH96879> (referer: https://www.auto1.com/v1/car-details-view/HH96879/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU52252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:32 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK11532%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [auto1.nl] INFO: Scrape type for JK11532: 2
2026-03-27 19:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3b66afa-146a-5114-a14b-5a1d83ea4c2d with identifier: JK11532
2026-03-27 19:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3b66afa-146a-5114-a14b-5a1d83ea4c2d with scrape type 2
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3b66afa-146a-5114-a14b-5a1d83ea4c2d with scrape type 2
2026-03-27 19:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c3b66afa-146a-5114-a14b-5a1d83ea4c2d, identifier: JK11532
2026-03-27 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WM00486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbdd650>
2026-03-27 19:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252F2f%252F572f2fe4feb32a12ab8fd8993fcdfd64%252Fpa%252FHB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg saved to cache
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc4ed060-3569-5d5a-b837-710f96c36a93
2026-03-27 19:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc4ed060-3569-5d5a-b837-710f96c36a93, skipping ID generation
2026-03-27 19:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc4ed060-3569-5d5a-b837-710f96c36a93 with scrape type 1
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc4ed060-3569-5d5a-b837-710f96c36a93 sending to next pipeline
2026-03-27 19:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cc4ed060-3569-5d5a-b837-710f96c36a93, identifier: HB03885
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_88c89d02f77fd0c480c8023e082cfa14.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_88c89d02f77fd0c480c8023e082cfa14.jpg not downloaded yet
2026-03-27 19:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c3b66afa-146a-5114-a14b-5a1d83ea4c2d with identifier: JK11532
2026-03-27 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c3b66afa-146a-5114-a14b-5a1d83ea4c2d with identifier: JK11532
2026-03-27 19:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c3b66afa-146a-5114-a14b-5a1d83ea4c2d with identifier: JK11532 to the API
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'diesel',
 'id': 'c3b66afa-146a-5114-a14b-5a1d83ea4c2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK11532',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 195229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,9t',
 'year': 2015}
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK11532%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [auto1.nl] INFO: Saving data for JK11532: {'auction_closing_time': 1774713662.0, 'created_time': 1773343422.780857, 'last_price_update_time': 1774638152.568261}
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK11532') HTTP/1.1" 204 0
2026-03-27 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-27 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885
2026-03-27 19:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cc4ed060-3569-5d5a-b837-710f96c36a93 with identifier: HB03885 to the API
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:27:32Z',
 'fuel_type': 'petrol',
 'id': 'cc4ed060-3569-5d5a-b837-710f96c36a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PG080B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB03885',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 132143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_061ad63f776500ec0f48d24c59b9fa13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_70603d656aac994c9b2a435765a71fb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_c318f9fdfc7dc205d63bf27169d444bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617710,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_3a0e00b2033794f953d824e543b71ad8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_1accae25ccf75a1d866c6cf52b2f45ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_ee3307919ff71f7957fce93d0edf58c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_4cc919b5467fb1a498661de0b88a7a7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_61021ed2062857709f39dcec874e9f6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_39f3bf739cec027e726857605f2628a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc4ed060-3569-5d5a-b837-710f96c36a93/cc4ed060-3569-5d5a-b837-710f96c36a93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/2f/572f2fe4feb32a12ab8fd8993fcdfd64/pa/HB03885_676f6f8faf55d02f62c3342fb5020918.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 SIDI Turbo INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2017}
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [auto1.nl] INFO: Saving data for HB03885: {'created_time': 1774638152.938112, 'last_price_update_time': 1774638152.938124, 'auction_closing_time': 1774715252.0}
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HB03885') HTTP/1.1" 204 0
2026-03-27 19:02:32 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK93829%27 HTTP/1.1" 200 None
2026-03-27 19:02:32 [auto1.nl] INFO: Scrape type for HK93829: 2
2026-03-27 19:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b225722c-6e89-50ff-b5be-524206b667ba with identifier: HK93829
2026-03-27 19:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b225722c-6e89-50ff-b5be-524206b667ba with scrape type 2
2026-03-27 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b225722c-6e89-50ff-b5be-524206b667ba with scrape type 2
2026-03-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b225722c-6e89-50ff-b5be-524206b667ba, identifier: HK93829
2026-03-27 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_1fb0f127b18541507251add5178a580d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_1fb0f127b18541507251add5178a580d.jpg not downloaded yet
2026-03-27 19:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b225722c-6e89-50ff-b5be-524206b667ba with identifier: HK93829
2026-03-27 19:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b225722c-6e89-50ff-b5be-524206b667ba with identifier: HK93829
2026-03-27 19:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b225722c-6e89-50ff-b5be-524206b667ba with identifier: HK93829 to the API
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:37:49Z',
 'fuel_type': 'petrol',
 'id': 'b225722c-6e89-50ff-b5be-524206b667ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK93829',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 176536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2018}
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK93829%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [auto1.nl] INFO: Saving data for HK93829: {'auction_closing_time': 1774715869.0, 'created_time': 1773406782.053513, 'last_price_update_time': 1774638153.383867}
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK93829') HTTP/1.1" 204 0
2026-03-27 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC22580> (referer: https://www.auto1.com/v1/car-details-view/VC22580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with scrape type 1
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_d29127b714d848c5fa78d165b476de98.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_d29127b714d848c5fa78d165b476de98.jpg not downloaded yet
2026-03-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dfe98e8-9de2-5539-996a-0a94db378a76 with identifier: HH96879
2026-03-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfe98e8-9de2-5539-996a-0a94db378a76 with scrape type 1
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg not downloaded yet
2026-03-27 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_0baad28eb0651abe63f32ffbc55ed318.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:33 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-27 19:02:33 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-27 19:02:33 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [auto1.nl] INFO: Scrape type for SE62217: 2
2026-03-27 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-27 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-27 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9915c0d2-005b-5323-8029-ffe268817221, identifier: SE62217
2026-03-27 19:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_f71df60953ccb2850dec1e47ee71c479.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_f71df60953ccb2850dec1e47ee71c479.jpg not downloaded yet
2026-03-27 19:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-27 19:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-27 19:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217 to the API
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 8,
 'expiration_date': '2026-03-28T16:06:49Z',
 'fuel_type': 'electro',
 'id': '9915c0d2-005b-5323-8029-ffe268817221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE62217',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Ami',
 'odometer': 32207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-06',
 'seller_name': None,
 'title': 'Citroen Ami electric drive 6 kW My Ami Cargo',
 'transmission': 'automatic',
 'trim': 'My  Cargo',
 'year': 2022}
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [auto1.nl] INFO: Saving data for SE62217: {'auction_closing_time': 1774714009.0, 'created_time': 1773688384.100909, 'last_price_update_time': 1774638153.861793}
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE62217') HTTP/1.1" 204 0
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_fe8417ed50f5c44de5ea2f509280a013.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_fe8417ed50f5c44de5ea2f509280a013.jpg not downloaded yet
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg not downloaded yet
2026-03-27 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:33 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [auto1.nl] INFO: Scrape type for YU38024: 2
2026-03-27 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-27 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-27 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 568f8074-76fa-5f5a-bd3b-e2456a91dc16, identifier: YU38024
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd2f5d0>
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg saved to cache
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-27 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024 to the API
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:23Z',
 'fuel_type': 'petrol',
 'id': '568f8074-76fa-5f5a-bd3b-e2456a91dc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU38024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 112334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2015}
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [auto1.nl] INFO: Saving data for YU38024: {'auction_closing_time': 1774714223.0, 'created_time': 1773749305.406642, 'last_price_update_time': 1774638154.503848}
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU38024') HTTP/1.1" 204 0
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_510e6373ea191117ba73ae5b937afef5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_510e6373ea191117ba73ae5b937afef5.jpg not downloaded yet
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg not downloaded yet
2026-03-27 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_88c89d02f77fd0c480c8023e082cfa14.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:34 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-27 19:02:34 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-27 19:02:34 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [auto1.nl] INFO: Scrape type for KP52767: 2
2026-03-27 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-27 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-27 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9de1d7e-d424-575c-a115-9a0d1824c3c8, identifier: KP52767
2026-03-27 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-27 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed90480f-f56a-56e4-a6e6-283468156c1f with scrape type 1
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_238231c6b83d65fda0bf93344e97aaa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_238231c6b83d65fda0bf93344e97aaa4.jpg not downloaded yet
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc58050>
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_0baad28eb0651abe63f32ffbc55ed318.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_0baad28eb0651abe63f32ffbc55ed318.jpg saved to cache
2026-03-27 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-27 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-27 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767 to the API
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:51:36Z',
 'fuel_type': 'petrol',
 'id': 'd9de1d7e-d424-575c-a115-9a0d1824c3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP52767',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 220004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [auto1.nl] INFO: Saving data for KP52767: {'auction_closing_time': 1774716696.0, 'created_time': 1774267368.098651, 'last_price_update_time': 1774638155.061795}
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP52767') HTTP/1.1" 204 0
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_cf60ee55eb338ff6603775919dd59a56.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_cf60ee55eb338ff6603775919dd59a56.jpg not downloaded yet
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg not downloaded yet
2026-03-27 19:02:35 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-27 19:02:35 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [auto1.nl] INFO: Scrape type for KB67971: 2
2026-03-27 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-27 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e425e933-a83a-53b9-b039-9ffefbf5d9b2 with scrape type 2
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e425e933-a83a-53b9-b039-9ffefbf5d9b2 with scrape type 2
2026-03-27 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e425e933-a83a-53b9-b039-9ffefbf5d9b2, identifier: KB67971
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg not downloaded yet
2026-03-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV69786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD60713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UD56346> (referer: https://www.auto1.com/v1/car-details-view/UD56346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9e8d62d0>
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg saved to cache
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-27 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971
2026-03-27 19:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e425e933-a83a-53b9-b039-9ffefbf5d9b2 with identifier: KB67971 to the API
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:27:08Z',
 'fuel_type': 'petrol',
 'id': 'e425e933-a83a-53b9-b039-9ffefbf5d9b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB67971',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 155250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-03',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [auto1.nl] INFO: Saving data for KB67971: {'auction_closing_time': 1774715228.0, 'created_time': 1773921665.69155, 'last_price_update_time': 1774638155.567301}
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB67971') HTTP/1.1" 204 0
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg not downloaded yet
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg not downloaded yet
2026-03-27 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ec0bad0>
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_88c89d02f77fd0c480c8023e082cfa14.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_88c89d02f77fd0c480c8023e082cfa14.jpg saved to cache
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:35 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [auto1.nl] INFO: Scrape type for EE94160: 2
2026-03-27 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-27 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with scrape type 2
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with scrape type 2
2026-03-27 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da, identifier: EE94160
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_8c298e0e7250aee33f792c49e8d70d13.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_8c298e0e7250aee33f792c49e8d70d13.jpg not downloaded yet
2026-03-27 19:02:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c969d50>
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg saved to cache
2026-03-27 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-27 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160
2026-03-27 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1abb55d4-95e6-5bd5-9857-4dd48e1f08da with identifier: EE94160 to the API
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:25:05Z',
 'fuel_type': 'petrol',
 'id': '1abb55d4-95e6-5bd5-9857-4dd48e1f08da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE94160',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 222625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2013}
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Saving data for EE94160: {'auction_closing_time': 1774715105.0, 'created_time': 1773837093.192047, 'last_price_update_time': 1774638156.338795}
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EE94160') HTTP/1.1" 204 0
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB49049> (referer: https://www.auto1.com/v1/car-details-view/JB49049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for JJ92825: 2
2026-03-27 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-27 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ff71f83-0f7c-5b37-9a34-13257e58632b with scrape type 2
2026-03-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ff71f83-0f7c-5b37-9a34-13257e58632b with scrape type 2
2026-03-27 19:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ff71f83-0f7c-5b37-9a34-13257e58632b, identifier: JJ92825
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_978013d520adf9d78b4cac379209f1e3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_978013d520adf9d78b4cac379209f1e3.jpg not downloaded yet
2026-03-27 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV86348> (referer: https://www.auto1.com/v1/car-details-view/XV86348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE05380> (referer: https://www.auto1.com/v1/car-details-view/DE05380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG40185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb22b31-342a-51b0-b868-f626f0176ef5 with identifier: UD56346
2026-03-27 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb22b31-342a-51b0-b868-f626f0176ef5 with scrape type 1
2026-03-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg not downloaded yet
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-27 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825
2026-03-27 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ff71f83-0f7c-5b37-9a34-13257e58632b with identifier: JJ92825 to the API
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:02:34Z',
 'fuel_type': 'petrol',
 'id': '8ff71f83-0f7c-5b37-9a34-13257e58632b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ92825',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 91220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X- Style',
 'transmission': 'manual',
 'trim': 'X- Style',
 'year': 2017}
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Saving data for JJ92825: {'auction_closing_time': 1774713754.0, 'created_time': 1773921684.245869, 'last_price_update_time': 1774638156.84264}
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ92825') HTTP/1.1" 204 0
2026-03-27 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_238231c6b83d65fda0bf93344e97aaa4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_cf60ee55eb338ff6603775919dd59a56.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for FB63193: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for JJ87309: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-27 19:02:36 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-27 19:02:36 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 19:02:37 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [auto1.nl] INFO: Scrape type for WS58210: 0
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg not downloaded yet
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg not downloaded yet
2026-03-27 19:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb46550>
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg saved to cache
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-27 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0191a4-a2d9-5653-9461-a14e58c94269 with scrape type 1
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_75846da9365011d981842ee9fd2ee530.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_75846da9365011d981842ee9fd2ee530.jpg not downloaded yet
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fce8390>
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg saved to cache
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg not downloaded yet
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg not downloaded yet
2026-03-27 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-27 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with scrape type 1
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_6b967be7f2485f9b10810db31e24ec57.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6b967be7f2485f9b10810db31e24ec57.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_f39973369e7a03b011ae3ceebdcdf972.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_f39973369e7a03b011ae3ceebdcdf972.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_5d3b8c9444ccaf42f2c7595e139f14c7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_5d3b8c9444ccaf42f2c7595e139f14c7.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_6292b1197b772df9cf3ee193256bd9f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6292b1197b772df9cf3ee193256bd9f7.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_93fbbe7559e0c3dd995e270ffd39829b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_93fbbe7559e0c3dd995e270ffd39829b.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_0136bece4e323d8daeaef226ed9a3aa4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_0136bece4e323d8daeaef226ed9a3aa4.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_d48069240803648c18d93720280f4fb5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d48069240803648c18d93720280f4fb5.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_07683ca51f72fe4d171500d75fa39f54.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_07683ca51f72fe4d171500d75fa39f54.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_d051cf6f2b91dffb29a64a515a254095.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d051cf6f2b91dffb29a64a515a254095.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F22%252F892235af097b90bb93e5e33edd1384df%252Fpa%252FXV86348_3da6f7ccf3313eebc79c8e97efaface0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_3da6f7ccf3313eebc79c8e97efaface0.jpg already downloaded
2026-03-27 19:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a, identifier: XV86348
2026-03-27 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-27 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c0d279-c2a7-5053-8de8-0f6fd8635142 with scrape type 1
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96c0d279-c2a7-5053-8de8-0f6fd8635142
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_7afeedbc31c90781497a99c48067d5f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_7afeedbc31c90781497a99c48067d5f6.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_16a6134e0b635f40d51ff0dfe2bb331a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_16a6134e0b635f40d51ff0dfe2bb331a.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_23b22947ead9d45d8f59292033330a91.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_23b22947ead9d45d8f59292033330a91.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_4849e9a2cde237e454fe826fa564be40.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4849e9a2cde237e454fe826fa564be40.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_dbe83e4ca496973158c0aa14911a1ed4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_dbe83e4ca496973158c0aa14911a1ed4.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_4d4c2e76c29e497b2f11eebb3b4dff62.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4d4c2e76c29e497b2f11eebb3b4dff62.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_d2b6a860d806166a07db13eefbe8a779.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_d2b6a860d806166a07db13eefbe8a779.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_2f3b84aed4e85e5a8418fd24d32edfbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2f3b84aed4e85e5a8418fd24d32edfbe.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_fad4a610fd2f723eed5fcca49a3f1744.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_fad4a610fd2f723eed5fcca49a3f1744.jpg already downloaded
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F3b%252F143bed9ba0044bc0061d50264b031b93%252Fpa%252FDE05380_2b2638bd16b08e5b63b79ba31e0fbbd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2b2638bd16b08e5b63b79ba31e0fbbd3.jpg already downloaded
2026-03-27 19:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96c0d279-c2a7-5053-8de8-0f6fd8635142, identifier: DE05380
2026-03-27 19:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c965c10>
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F97%252Fbe97250743bba104acad7bc174198e8a%252Fpa%252FTJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg saved to cache
2026-03-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 341bf896-a01e-5195-90fc-ac4dcc6a334d
2026-03-27 19:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 341bf896-a01e-5195-90fc-ac4dcc6a334d, skipping ID generation
2026-03-27 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341bf896-a01e-5195-90fc-ac4dcc6a334d with scrape type 1
2026-03-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 341bf896-a01e-5195-90fc-ac4dcc6a334d sending to next pipeline
2026-03-27 19:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 341bf896-a01e-5195-90fc-ac4dcc6a334d, identifier: TJ92302
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_7b542ccfd47160575469a3bdc92f1579.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_7b542ccfd47160575469a3bdc92f1579.jpg not downloaded yet
2026-03-27 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX59899> (referer: https://www.auto1.com/v1/car-details-view/DX59899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-27 19:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348
2026-03-27 19:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a with identifier: XV86348 to the API
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV86348>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:18Z',
 'fuel_type': 'petrol',
 'id': 'ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '62ZXN2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV86348',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 199609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6b967be7f2485f9b10810db31e24ec57.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_f39973369e7a03b011ae3ceebdcdf972.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_5d3b8c9444ccaf42f2c7595e139f14c7.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6292b1197b772df9cf3ee193256bd9f7.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_93fbbe7559e0c3dd995e270ffd39829b.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_0136bece4e323d8daeaef226ed9a3aa4.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d48069240803648c18d93720280f4fb5.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_07683ca51f72fe4d171500d75fa39f54.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d051cf6f2b91dffb29a64a515a254095.jpg',
                'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_3da6f7ccf3313eebc79c8e97efaface0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6b967be7f2485f9b10810db31e24ec57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_f39973369e7a03b011ae3ceebdcdf972.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_5d3b8c9444ccaf42f2c7595e139f14c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_6292b1197b772df9cf3ee193256bd9f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_93fbbe7559e0c3dd995e270ffd39829b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_0136bece4e323d8daeaef226ed9a3aa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d48069240803648c18d93720280f4fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_07683ca51f72fe4d171500d75fa39f54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_d051cf6f2b91dffb29a64a515a254095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a/ed57d0d0-b97d-55f9-b55c-aa8d77d2c32a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/22/892235af097b90bb93e5e33edd1384df/pa/XV86348_3da6f7ccf3313eebc79c8e97efaface0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-27 19:02:38 [auto1.nl] INFO: Saving data for XV86348: {'created_time': 1774638158.381218, 'last_price_update_time': 1774638158.381228, 'auction_closing_time': 1774714158.0}
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV86348') HTTP/1.1" 204 0
2026-03-27 19:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-27 19:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380
2026-03-27 19:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96c0d279-c2a7-5053-8de8-0f6fd8635142 with identifier: DE05380 to the API
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DE05380>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:52:54Z',
 'fuel_type': 'petrol',
 'id': '96c0d279-c2a7-5053-8de8-0f6fd8635142',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NJ895S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE05380',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 203988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_7afeedbc31c90781497a99c48067d5f6.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_16a6134e0b635f40d51ff0dfe2bb331a.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_23b22947ead9d45d8f59292033330a91.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4849e9a2cde237e454fe826fa564be40.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_dbe83e4ca496973158c0aa14911a1ed4.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4d4c2e76c29e497b2f11eebb3b4dff62.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_d2b6a860d806166a07db13eefbe8a779.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2f3b84aed4e85e5a8418fd24d32edfbe.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_fad4a610fd2f723eed5fcca49a3f1744.jpg',
                'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2b2638bd16b08e5b63b79ba31e0fbbd3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2297819,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_7afeedbc31c90781497a99c48067d5f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_16a6134e0b635f40d51ff0dfe2bb331a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_23b22947ead9d45d8f59292033330a91.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414276,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4849e9a2cde237e454fe826fa564be40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2461546,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_dbe83e4ca496973158c0aa14911a1ed4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2539918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_4d4c2e76c29e497b2f11eebb3b4dff62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_d2b6a860d806166a07db13eefbe8a779.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2f3b84aed4e85e5a8418fd24d32edfbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_fad4a610fd2f723eed5fcca49a3f1744.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96c0d279-c2a7-5053-8de8-0f6fd8635142/96c0d279-c2a7-5053-8de8-0f6fd8635142_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2466918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/3b/143bed9ba0044bc0061d50264b031b93/pa/DE05380_2b2638bd16b08e5b63b79ba31e0fbbd3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion Tech',
 'year': 2013}
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-27 19:02:38 [auto1.nl] INFO: Saving data for DE05380: {'created_time': 1774638158.832455, 'last_price_update_time': 1774638158.832469, 'auction_closing_time': 1774716774.0}
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DE05380') HTTP/1.1" 204 0
2026-03-27 19:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 341bf896-a01e-5195-90fc-ac4dcc6a334d with identifier: TJ92302
2026-03-27 19:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 341bf896-a01e-5195-90fc-ac4dcc6a334d with identifier: TJ92302
2026-03-27 19:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 341bf896-a01e-5195-90fc-ac4dcc6a334d with identifier: TJ92302 to the API
2026-03-27 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'diesel',
 'id': '341bf896-a01e-5195-90fc-ac4dcc6a334d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '4SNV91',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ92302',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 242897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_6445ae09697dbfc860dad026441001dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4ef4f1a3078062262185682b16e2ea24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_cefcf77bf09f3142220cdebcfa4ca5b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763788,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d07df1d4aec872cfd853b1a7c3a08a7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_28df5dd13a69c11251d83994801b5115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_0982d077af5a4627a9004b6c1e927074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_bcba44e5760508648cf0fa7271595b29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_8317d3824472e6498fc7a58211f0b122.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_d05b34e1cb82ad98fcbaf576c176d370.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_341bf896-a01e-5195-90fc-ac4dcc6a334d/341bf896-a01e-5195-90fc-ac4dcc6a334d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/97/be97250743bba104acad7bc174198e8a/pa/TJ92302_4650b728777248d611bf277bf760540f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2012}
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ92302%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [auto1.nl] INFO: Saving data for TJ92302: {'created_time': 1774638159.193939, 'last_price_update_time': 1774638159.19395, 'auction_closing_time': 1774716923.0}
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TJ92302') HTTP/1.1" 204 0
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc9ec90>
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_238231c6b83d65fda0bf93344e97aaa4.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_238231c6b83d65fda0bf93344e97aaa4.jpg saved to cache
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c95e790>
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg saved to cache
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9a650>
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_cf60ee55eb338ff6603775919dd59a56.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_cf60ee55eb338ff6603775919dd59a56.jpg saved to cache
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_f71df60953ccb2850dec1e47ee71c479.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_510e6373ea191117ba73ae5b937afef5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg not downloaded yet
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg not downloaded yet
2026-03-27 19:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_2e76e36988758ab9f695d014fc6726af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_2e76e36988758ab9f695d014fc6726af.jpg not downloaded yet
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV54622> (referer: https://www.auto1.com/v1/car-details-view/WV54622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG63197> (referer: https://www.auto1.com/v1/car-details-view/NG63197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9abd0>
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg saved to cache
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_fe8417ed50f5c44de5ea2f509280a013.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg not downloaded yet
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_93c8154b445a03712c02fe570a791267.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_93c8154b445a03712c02fe570a791267.jpg not downloaded yet
2026-03-27 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01c7f3a2-2aa3-5157-9c99-b65545de9a67 with identifier: DX59899
2026-03-27 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01c7f3a2-2aa3-5157-9c99-b65545de9a67 with scrape type 1
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01c7f3a2-2aa3-5157-9c99-b65545de9a67
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_2dc95003e39f86929ca7523044a514a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_2dc95003e39f86929ca7523044a514a8.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_a7e2bff9cbd227327f6bb96b51225d19.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_a7e2bff9cbd227327f6bb96b51225d19.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_cddb3a4f13b137701d9c979c931acabe.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_cddb3a4f13b137701d9c979c931acabe.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_37a1bf741afd88a1c3c28fff05443bc7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_37a1bf741afd88a1c3c28fff05443bc7.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_3b7e046e1039301ba8f2b2cc357648e4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_3b7e046e1039301ba8f2b2cc357648e4.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_e41096720e13868f6ad794303a4a3ccf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_e41096720e13868f6ad794303a4a3ccf.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_c5a4606cc5fe861dcb102285c834ba81.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_c5a4606cc5fe861dcb102285c834ba81.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_b56f465bd8a017cb0d0a9e23504bf7af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_b56f465bd8a017cb0d0a9e23504bf7af.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_5763d2785791758f7084a60391cb716b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_5763d2785791758f7084a60391cb716b.jpg already downloaded
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252Fc7%252F8cc78bb8c17c2d8d42c9f32d8dbaa942%252Fpa%252FDX59899_f36b541dc563dcec00dc3dcc2b12e267.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_f36b541dc563dcec00dc3dcc2b12e267.jpg already downloaded
2026-03-27 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01c7f3a2-2aa3-5157-9c99-b65545de9a67, identifier: DX59899
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg not downloaded yet
2026-03-27 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01c7f3a2-2aa3-5157-9c99-b65545de9a67 with identifier: DX59899
2026-03-27 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01c7f3a2-2aa3-5157-9c99-b65545de9a67 with identifier: DX59899
2026-03-27 19:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01c7f3a2-2aa3-5157-9c99-b65545de9a67 with identifier: DX59899 to the API
2026-03-27 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX59899>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:44:36Z',
 'fuel_type': 'petrol',
 'id': '01c7f3a2-2aa3-5157-9c99-b65545de9a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX59899',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 180672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 20,
 'photo_urls': ['https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_2dc95003e39f86929ca7523044a514a8.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_a7e2bff9cbd227327f6bb96b51225d19.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_cddb3a4f13b137701d9c979c931acabe.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_37a1bf741afd88a1c3c28fff05443bc7.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_3b7e046e1039301ba8f2b2cc357648e4.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_e41096720e13868f6ad794303a4a3ccf.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_c5a4606cc5fe861dcb102285c834ba81.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_b56f465bd8a017cb0d0a9e23504bf7af.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_5763d2785791758f7084a60391cb716b.jpg',
                'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_f36b541dc563dcec00dc3dcc2b12e267.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_2dc95003e39f86929ca7523044a514a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_a7e2bff9cbd227327f6bb96b51225d19.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_cddb3a4f13b137701d9c979c931acabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_37a1bf741afd88a1c3c28fff05443bc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_3b7e046e1039301ba8f2b2cc357648e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_e41096720e13868f6ad794303a4a3ccf.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_c5a4606cc5fe861dcb102285c834ba81.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_b56f465bd8a017cb0d0a9e23504bf7af.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_5763d2785791758f7084a60391cb716b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01c7f3a2-2aa3-5157-9c99-b65545de9a67/01c7f3a2-2aa3-5157-9c99-b65545de9a67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/c7/8cc78bb8c17c2d8d42c9f32d8dbaa942/pa/DX59899_f36b541dc563dcec00dc3dcc2b12e267.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2012}
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX59899%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [auto1.nl] INFO: Saving data for DX59899: {'created_time': 1774638160.152143, 'last_price_update_time': 1774638160.152155, 'auction_closing_time': 1774716276.0}
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX59899') HTTP/1.1" 204 0
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_55bbe10b274eb7779afb6efca6418b56.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_55bbe10b274eb7779afb6efca6418b56.jpg not downloaded yet
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg not downloaded yet
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff5d050>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9409d0>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_f71df60953ccb2850dec1e47ee71c479.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_f71df60953ccb2850dec1e47ee71c479.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb39b10>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_510e6373ea191117ba73ae5b937afef5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_510e6373ea191117ba73ae5b937afef5.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg not downloaded yet
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WM00486> (referer: https://www.auto1.com/v1/car-details-view/WM00486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_7b542ccfd47160575469a3bdc92f1579.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_fc57ff1dca1583452814117b7be0e7f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_fc57ff1dca1583452814117b7be0e7f6.jpg not downloaded yet
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_03b92d611309ab269d696fd12bbf75b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_03b92d611309ab269d696fd12bbf75b6.jpg not downloaded yet
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd6d350>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff722d0>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-27 19:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea621380-23dc-5f4d-a572-bd135e241e18 with scrape type 1
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea621380-23dc-5f4d-a572-bd135e241e18
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_b69c389f5d355d76dc240e03511a0e49.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b69c389f5d355d76dc240e03511a0e49.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_f138208e7ec80eed74d2796fb03618b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f138208e7ec80eed74d2796fb03618b0.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_b666a07feffddf3ac72e154c9d12676b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b666a07feffddf3ac72e154c9d12676b.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_17120ba01d0990cc0fbce7732f793b49.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_17120ba01d0990cc0fbce7732f793b49.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_b55acf062845e269abcedc8cb11e1ecb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b55acf062845e269abcedc8cb11e1ecb.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_758e5d6035963f117a3a9a0c186089d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_758e5d6035963f117a3a9a0c186089d5.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_a734c8d39c03ade85ae63f98afea4e8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_a734c8d39c03ade85ae63f98afea4e8f.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_9fcaaa611822c8419d10819d2afcf5be.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_9fcaaa611822c8419d10819d2afcf5be.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_f431b186e9a40ec525cf089fae36e74e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f431b186e9a40ec525cf089fae36e74e.jpg already downloaded
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fe9%252F9ce979949a67f098678d0296f440f69d%252Fpa%252FWV54622_8f7c786cfd89a9e7de7a596620bfadd9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_8f7c786cfd89a9e7de7a596620bfadd9.jpg already downloaded
2026-03-27 19:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea621380-23dc-5f4d-a572-bd135e241e18, identifier: WV54622
2026-03-27 19:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29f64f5-943d-5e80-93a7-07f11492283e with identifier: NG63197
2026-03-27 19:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29f64f5-943d-5e80-93a7-07f11492283e with scrape type 1
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg not downloaded yet
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff71d50>
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_fe8417ed50f5c44de5ea2f509280a013.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_fe8417ed50f5c44de5ea2f509280a013.jpg saved to cache
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_fba105e2eaccd4b28985a7350bfa326a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fba105e2eaccd4b28985a7350bfa326a.jpg not downloaded yet
2026-03-27 19:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-27 19:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622
2026-03-27 19:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea621380-23dc-5f4d-a572-bd135e241e18 with identifier: WV54622 to the API
2026-03-27 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WV54622>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:44:59Z',
 'fuel_type': 'petrol',
 'id': 'ea621380-23dc-5f4d-a572-bd135e241e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SF694D',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV54622',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 134825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b69c389f5d355d76dc240e03511a0e49.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f138208e7ec80eed74d2796fb03618b0.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b666a07feffddf3ac72e154c9d12676b.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_17120ba01d0990cc0fbce7732f793b49.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b55acf062845e269abcedc8cb11e1ecb.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_758e5d6035963f117a3a9a0c186089d5.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_a734c8d39c03ade85ae63f98afea4e8f.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_9fcaaa611822c8419d10819d2afcf5be.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f431b186e9a40ec525cf089fae36e74e.jpg',
                'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_8f7c786cfd89a9e7de7a596620bfadd9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b69c389f5d355d76dc240e03511a0e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f138208e7ec80eed74d2796fb03618b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b666a07feffddf3ac72e154c9d12676b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_17120ba01d0990cc0fbce7732f793b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_b55acf062845e269abcedc8cb11e1ecb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_758e5d6035963f117a3a9a0c186089d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_a734c8d39c03ade85ae63f98afea4e8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_9fcaaa611822c8419d10819d2afcf5be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_f431b186e9a40ec525cf089fae36e74e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea621380-23dc-5f4d-a572-bd135e241e18/ea621380-23dc-5f4d-a572-bd135e241e18_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/e9/9ce979949a67f098678d0296f440f69d/pa/WV54622_8f7c786cfd89a9e7de7a596620bfadd9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2018}
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Saving data for WV54622: {'created_time': 1774638161.202138, 'last_price_update_time': 1774638161.202148, 'auction_closing_time': 1774716299.0}
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV54622') HTTP/1.1" 204 0
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_02a2a460752c4bad871c7e1d74a31e46.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_02a2a460752c4bad871c7e1d74a31e46.jpg not downloaded yet
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg not downloaded yet
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_978013d520adf9d78b4cac379209f1e3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg not downloaded yet
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN86544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff7c190>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg saved to cache
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc8c490>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg saved to cache
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with identifier: WM00486
2026-03-27 19:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with scrape type 1
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_177c2a73665768f06cb4f1d822f1c58c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_177c2a73665768f06cb4f1d822f1c58c.jpg not downloaded yet
2026-03-27 19:02:41 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 916 | hits on page: 40
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe698d0>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg saved to cache
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc5a110>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_7b542ccfd47160575469a3bdc92f1579.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_7b542ccfd47160575469a3bdc92f1579.jpg saved to cache
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_93c8154b445a03712c02fe570a791267.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg not downloaded yet
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_5d3433393e7e4af59b7886aa70bf6684.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_5d3433393e7e4af59b7886aa70bf6684.jpg not downloaded yet
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV69786> (referer: https://www.auto1.com/v1/car-details-view/KV69786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD60713> (referer: https://www.auto1.com/v1/car-details-view/FD60713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg not downloaded yet
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_6716cb616584cd3c0b59703e44e68c7f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_6716cb616584cd3c0b59703e44e68c7f.jpg not downloaded yet
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for US57687: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for AB05434: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB92284%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for AB92284: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for EF55872: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for TJ45732: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for GA80832: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for UT08140: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for LY14996: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for UC04146: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for UB37816: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [auto1.nl] INFO: Scrape type for GX38555: 0
2026-03-27 19:02:41 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-27 19:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg not downloaded yet
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg not downloaded yet
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbdee90>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg saved to cache
2026-03-27 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c933090>
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_978013d520adf9d78b4cac379209f1e3.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_978013d520adf9d78b4cac379209f1e3.jpg saved to cache
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_55bbe10b274eb7779afb6efca6418b56.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_3354e8443e11f6795691edf648e17206.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_3354e8443e11f6795691edf648e17206.jpg not downloaded yet
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_2a1006f5af96a832729cd5d461a23542.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_2a1006f5af96a832729cd5d461a23542.jpg not downloaded yet
2026-03-27 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_68aaf6de5d85d81702d67efa57276956.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_68aaf6de5d85d81702d67efa57276956.jpg not downloaded yet
2026-03-27 19:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca6c990>
2026-03-27 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_93c8154b445a03712c02fe570a791267.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_93c8154b445a03712c02fe570a791267.jpg saved to cache
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-27 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 134bdab2-9013-5964-9b6d-8bc345995384 with scrape type 1
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 134bdab2-9013-5964-9b6d-8bc345995384
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_03530830b28396a7cef6854cb197fed5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_03530830b28396a7cef6854cb197fed5.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_de019cf4d362614cfbd1e72e717c22e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_de019cf4d362614cfbd1e72e717c22e6.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_58d5e70c1ab749ab8e2b100b1717c6ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_58d5e70c1ab749ab8e2b100b1717c6ce.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_a5fdb466d9d9e382cbf9e321a7048312.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_a5fdb466d9d9e382cbf9e321a7048312.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_972adb08fc913d7eab29757e50de7454.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_972adb08fc913d7eab29757e50de7454.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_da408d9c4c3b15f4644b058ccb70681d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_da408d9c4c3b15f4644b058ccb70681d.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_947256e7934b4bb2a52a8d22cdeac764.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_947256e7934b4bb2a52a8d22cdeac764.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_f9d294c99891e97a340bec710627d01f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_f9d294c99891e97a340bec710627d01f.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_16de0982a2680c225b1945f1f6cc3dfc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_16de0982a2680c225b1945f1f6cc3dfc.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252Fc1%252F77c1471ca43192d5d85981ce58be2945%252Fpa%252FKV69786_cb9c3a766eeac9baee5c8712145321ee.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_cb9c3a766eeac9baee5c8712145321ee.jpg already downloaded
2026-03-27 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 134bdab2-9013-5964-9b6d-8bc345995384, identifier: KV69786
2026-03-27 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-27 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536b9c62-123e-5bd5-8bef-231067a49465 with scrape type 1
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 536b9c62-123e-5bd5-8bef-231067a49465
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_d408e47dd40167356429c7de3d081df1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_d408e47dd40167356429c7de3d081df1.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_50d90622c9d3ac08f4e629a2d5055fc5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50d90622c9d3ac08f4e629a2d5055fc5.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_79a4d5be7d35b74debfd1b3cb4358de2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_79a4d5be7d35b74debfd1b3cb4358de2.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_7f83f43f25495f3e605ab527ec259da8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_7f83f43f25495f3e605ab527ec259da8.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_e04681d76ca79c02e2b454f8b302276d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_e04681d76ca79c02e2b454f8b302276d.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_c2861523ab2666fdabca4ad062e6b0f2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_c2861523ab2666fdabca4ad062e6b0f2.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_50a839fae9102835e32b785ddc3bd9ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50a839fae9102835e32b785ddc3bd9ec.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_0bfa5a4399130dc975ba2f9009daa8b1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_0bfa5a4399130dc975ba2f9009daa8b1.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_4df6c83017ea580c9807af5103efe7f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_4df6c83017ea580c9807af5103efe7f8.jpg already downloaded
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Ff3%252Fc1f3ca931306e63fe62b52b6c610a571%252Fpa%252FFD60713_49406dca7f3ef77377500622f6ce46af.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_49406dca7f3ef77377500622f6ce46af.jpg already downloaded
2026-03-27 19:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 536b9c62-123e-5bd5-8bef-231067a49465, identifier: FD60713
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg not downloaded yet
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_87cead1cce566c3590c6f97bdcb4f615.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_87cead1cce566c3590c6f97bdcb4f615.jpg not downloaded yet
2026-03-27 19:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-27 19:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786
2026-03-27 19:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 134bdab2-9013-5964-9b6d-8bc345995384 with identifier: KV69786 to the API
2026-03-27 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV69786>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:17:38Z',
 'fuel_type': 'petrol',
 'id': '134bdab2-9013-5964-9b6d-8bc345995384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XJ574S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV69786',
 'listing': 'auction',
 'location': 'NL, Den Hout',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 104895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_03530830b28396a7cef6854cb197fed5.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_de019cf4d362614cfbd1e72e717c22e6.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_58d5e70c1ab749ab8e2b100b1717c6ce.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_a5fdb466d9d9e382cbf9e321a7048312.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_972adb08fc913d7eab29757e50de7454.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_da408d9c4c3b15f4644b058ccb70681d.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_947256e7934b4bb2a52a8d22cdeac764.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_f9d294c99891e97a340bec710627d01f.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_16de0982a2680c225b1945f1f6cc3dfc.jpg',
                'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_cb9c3a766eeac9baee5c8712145321ee.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3091098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_03530830b28396a7cef6854cb197fed5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_de019cf4d362614cfbd1e72e717c22e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3375333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_58d5e70c1ab749ab8e2b100b1717c6ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_a5fdb466d9d9e382cbf9e321a7048312.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3595934,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_972adb08fc913d7eab29757e50de7454.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_da408d9c4c3b15f4644b058ccb70681d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_947256e7934b4bb2a52a8d22cdeac764.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_f9d294c99891e97a340bec710627d01f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3226894,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_16de0982a2680c225b1945f1f6cc3dfc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_134bdab2-9013-5964-9b6d-8bc345995384/134bdab2-9013-5964-9b6d-8bc345995384_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/c1/77c1471ca43192d5d85981ce58be2945/pa/KV69786_cb9c3a766eeac9baee5c8712145321ee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2015}
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [auto1.nl] INFO: Saving data for KV69786: {'created_time': 1774638163.104452, 'last_price_update_time': 1774638163.104465, 'auction_closing_time': 1774714658.0}
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KV69786') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-27 19:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713
2026-03-27 19:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 536b9c62-123e-5bd5-8bef-231067a49465 with identifier: FD60713 to the API
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD60713>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:40:23Z',
 'fuel_type': 'diesel',
 'id': '536b9c62-123e-5bd5-8bef-231067a49465',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JL153X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD60713',
 'listing': 'auction',
 'location': 'NL, Staphorst',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 209811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_d408e47dd40167356429c7de3d081df1.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50d90622c9d3ac08f4e629a2d5055fc5.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_79a4d5be7d35b74debfd1b3cb4358de2.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_7f83f43f25495f3e605ab527ec259da8.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_e04681d76ca79c02e2b454f8b302276d.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_c2861523ab2666fdabca4ad062e6b0f2.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50a839fae9102835e32b785ddc3bd9ec.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_0bfa5a4399130dc975ba2f9009daa8b1.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_4df6c83017ea580c9807af5103efe7f8.jpg',
                'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_49406dca7f3ef77377500622f6ce46af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3334882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_d408e47dd40167356429c7de3d081df1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50d90622c9d3ac08f4e629a2d5055fc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_79a4d5be7d35b74debfd1b3cb4358de2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115200,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_7f83f43f25495f3e605ab527ec259da8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2946020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_e04681d76ca79c02e2b454f8b302276d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876253,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_c2861523ab2666fdabca4ad062e6b0f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2402656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_50a839fae9102835e32b785ddc3bd9ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_0bfa5a4399130dc975ba2f9009daa8b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_4df6c83017ea580c9807af5103efe7f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b9c62-123e-5bd5-8bef-231067a49465/536b9c62-123e-5bd5-8bef-231067a49465_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/f3/c1f3ca931306e63fe62b52b6c610a571/pa/FD60713_49406dca7f3ef77377500622f6ce46af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [auto1.nl] INFO: Saving data for FD60713: {'created_time': 1774638163.510865, 'last_price_update_time': 1774638163.510875, 'auction_closing_time': 1774716023.0}
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD60713') HTTP/1.1" 204 0
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca3ea90>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg not downloaded yet
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_2e76e36988758ab9f695d014fc6726af.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fba105e2eaccd4b28985a7350bfa326a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg not downloaded yet
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG40185> (referer: https://www.auto1.com/v1/car-details-view/FG40185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd57cd0>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_55bbe10b274eb7779afb6efca6418b56.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_55bbe10b274eb7779afb6efca6418b56.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8feeea10>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff6e110>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg not downloaded yet
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg not downloaded yet
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg not downloaded yet
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc69650>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9bd50>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_2e76e36988758ab9f695d014fc6726af.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_2e76e36988758ab9f695d014fc6726af.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9299d0>
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_fba105e2eaccd4b28985a7350bfa326a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fba105e2eaccd4b28985a7350bfa326a.jpg saved to cache
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c75e861-f8ca-550e-8e56-f257f3a58052 with identifier: FG40185
2026-03-27 19:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c75e861-f8ca-550e-8e56-f257f3a58052 with scrape type 1
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_11def92ec922df41ac97cf2309f2892c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_11def92ec922df41ac97cf2309f2892c.jpg not downloaded yet
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg not downloaded yet
2026-03-27 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_177c2a73665768f06cb4f1d822f1c58c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_19f120f80300d7db511a960fd6941a94.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_19f120f80300d7db511a960fd6941a94.jpg not downloaded yet
2026-03-27 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_2e1858f04e049ee768a0ea689ddba686.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_2e1858f04e049ee768a0ea689ddba686.jpg not downloaded yet
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_02a2a460752c4bad871c7e1d74a31e46.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_5d3433393e7e4af59b7886aa70bf6684.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_12b900063993849b905343be23896575.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_12b900063993849b905343be23896575.jpg not downloaded yet
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_6716cb616584cd3c0b59703e44e68c7f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg not downloaded yet
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg not downloaded yet
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_8c298e0e7250aee33f792c49e8d70d13.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg not downloaded yet
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cd810>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_b74c3e7e494e1c4b6279bc704873c669.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_b74c3e7e494e1c4b6279bc704873c669.jpg not downloaded yet
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg not downloaded yet
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff6d450>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_177c2a73665768f06cb4f1d822f1c58c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_177c2a73665768f06cb4f1d822f1c58c.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_8186b848308a8ce1f80b9cf4ac912869.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_8186b848308a8ce1f80b9cf4ac912869.jpg not downloaded yet
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb98f90>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_02a2a460752c4bad871c7e1d74a31e46.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_02a2a460752c4bad871c7e1d74a31e46.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc4d150>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_5d3433393e7e4af59b7886aa70bf6684.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_5d3433393e7e4af59b7886aa70bf6684.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff73310>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_6716cb616584cd3c0b59703e44e68c7f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_6716cb616584cd3c0b59703e44e68c7f.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg not downloaded yet
2026-03-27 19:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8cb390>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_8c298e0e7250aee33f792c49e8d70d13.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_8c298e0e7250aee33f792c49e8d70d13.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_87cead1cce566c3590c6f97bdcb4f615.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_68aaf6de5d85d81702d67efa57276956.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_cc8c33e77c1fab55c92842a6294144cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_cc8c33e77c1fab55c92842a6294144cc.jpg not downloaded yet
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN86544> (referer: https://www.auto1.com/v1/car-details-view/JN86544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_f842a8f863b3b8ac966ab10b4589f931.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f842a8f863b3b8ac966ab10b4589f931.jpg not downloaded yet
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc407d0>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg not downloaded yet
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_11def92ec922df41ac97cf2309f2892c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_3f79830f5dec5542eee675e852299ce9.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_3f79830f5dec5542eee675e852299ce9.jpg not downloaded yet
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ffaf950>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd64b10>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_87cead1cce566c3590c6f97bdcb4f615.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_87cead1cce566c3590c6f97bdcb4f615.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8feef1d0>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_68aaf6de5d85d81702d67efa57276956.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_68aaf6de5d85d81702d67efa57276956.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_12b900063993849b905343be23896575.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_8186b848308a8ce1f80b9cf4ac912869.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_2a1006f5af96a832729cd5d461a23542.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-27 19:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7e7017-7079-5943-8946-ee9d2f995822 with scrape type 1
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_cdcc4909893deebd3e31323029a6950b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_cdcc4909893deebd3e31323029a6950b.jpg not downloaded yet
2026-03-27 19:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd54750>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff738d0>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg saved to cache
2026-03-27 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdbd990>
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_11def92ec922df41ac97cf2309f2892c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_11def92ec922df41ac97cf2309f2892c.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_b74c3e7e494e1c4b6279bc704873c669.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg not downloaded yet
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_cc8c33e77c1fab55c92842a6294144cc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg not downloaded yet
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc64850>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_12b900063993849b905343be23896575.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_12b900063993849b905343be23896575.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff20d90>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_8186b848308a8ce1f80b9cf4ac912869.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_8186b848308a8ce1f80b9cf4ac912869.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fedcb50>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_2a1006f5af96a832729cd5d461a23542.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_2a1006f5af96a832729cd5d461a23542.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fedf690>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:45 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 916 | hits on page: 40
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb4aa10>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_00e95646558e515a369865fba1bf77b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_00e95646558e515a369865fba1bf77b5.jpg not downloaded yet
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for YU82988: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for VM29173: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for RR80165: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-27 19:02:45 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [auto1.nl] INFO: Scrape type for FX92385: 0
2026-03-27 19:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f842a8f863b3b8ac966ab10b4589f931.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_3f79830f5dec5542eee675e852299ce9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg not downloaded yet
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_2acf914d8f962984560ffea505502d12.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_2acf914d8f962984560ffea505502d12.jpg not downloaded yet
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9395d0>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_b74c3e7e494e1c4b6279bc704873c669.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_b74c3e7e494e1c4b6279bc704873c669.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd9dad0>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_cc8c33e77c1fab55c92842a6294144cc.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_cc8c33e77c1fab55c92842a6294144cc.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff6fb10>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc6b610>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg saved to cache
2026-03-27 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8febc610>
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg not downloaded yet
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_19f120f80300d7db511a960fd6941a94.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_75846da9365011d981842ee9fd2ee530.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_1977d5bffd4497aa720663c295cd04a8.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_1977d5bffd4497aa720663c295cd04a8.jpg not downloaded yet
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc75750>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_f842a8f863b3b8ac966ab10b4589f931.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f842a8f863b3b8ac966ab10b4589f931.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ecd05d0>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_3f79830f5dec5542eee675e852299ce9.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_3f79830f5dec5542eee675e852299ce9.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_b355a5a85ad939a106bc7778df808147.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_b355a5a85ad939a106bc7778df808147.jpg not downloaded yet
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_cdcc4909893deebd3e31323029a6950b.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg not downloaded yet
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cca90>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe5b090>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff6c910>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_19f120f80300d7db511a960fd6941a94.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_19f120f80300d7db511a960fd6941a94.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fe59750>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-27 19:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-03-27 19:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-27 19:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca6e1d0>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_75846da9365011d981842ee9fd2ee530.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_75846da9365011d981842ee9fd2ee530.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_3354e8443e11f6795691edf648e17206.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_00e95646558e515a369865fba1bf77b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd8a710>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_cdcc4909893deebd3e31323029a6950b.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_cdcc4909893deebd3e31323029a6950b.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd61110>
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Fc7%252Fc0c7c1e042254352f9fbc63dbfa1fe2c%252Fpa%252FWM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg saved to cache
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326
2026-03-27 19:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326, skipping ID generation
2026-03-27 19:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with scrape type 1
2026-03-27 19:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 sending to next pipeline
2026-03-27 19:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326, identifier: WM00486
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9b9c90>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_3354e8443e11f6795691edf648e17206.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_3354e8443e11f6795691edf648e17206.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9491d0>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdc4cd0>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_00e95646558e515a369865fba1bf77b5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_00e95646558e515a369865fba1bf77b5.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with identifier: WM00486
2026-03-27 19:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with identifier: WM00486
2026-03-27 19:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1fb7a9c0-bff1-5072-8fc4-b68afedd3326 with identifier: WM00486 to the API
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:53Z',
 'fuel_type': 'diesel',
 'id': '1fb7a9c0-bff1-5072-8fc4-b68afedd3326',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM00486',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_177c2a73665768f06cb4f1d822f1c58c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_6716cb616584cd3c0b59703e44e68c7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_2a1006f5af96a832729cd5d461a23542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_87cead1cce566c3590c6f97bdcb4f615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_c652283a7c759fec4b6ecd7a75930f2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_dde74e6c09eec6a5a910805e9e6e08d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_78fa06cdb959fe7cb2cdf634408efaa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_12b900063993849b905343be23896575.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_47a9bb7f4cf4f4ef73b6bad3db95c4cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1fb7a9c0-bff1-5072-8fc4-b68afedd3326/1fb7a9c0-bff1-5072-8fc4-b68afedd3326_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/c7/c0c7c1e042254352f9fbc63dbfa1fe2c/pa/WM00486_3def6dd0f3cb67d5faac7e69bcda7114.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2019}
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM00486%27 HTTP/1.1" 200 None
2026-03-27 19:02:47 [auto1.nl] INFO: Saving data for WM00486: {'created_time': 1774638167.487814, 'last_price_update_time': 1774638167.487827, 'auction_closing_time': 1774713893.0}
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM00486') HTTP/1.1" 204 0
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_2acf914d8f962984560ffea505502d12.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc636d0>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_2e1858f04e049ee768a0ea689ddba686.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8bae90>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fdb3cd0>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F58%252F6b5885e8b4750a2533802b17eda65719%252Fpa%252FNG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg saved to cache
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e29f64f5-943d-5e80-93a7-07f11492283e
2026-03-27 19:02:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e29f64f5-943d-5e80-93a7-07f11492283e, skipping ID generation
2026-03-27 19:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29f64f5-943d-5e80-93a7-07f11492283e with scrape type 1
2026-03-27 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e29f64f5-943d-5e80-93a7-07f11492283e sending to next pipeline
2026-03-27 19:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e29f64f5-943d-5e80-93a7-07f11492283e, identifier: NG63197
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca90710>
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg saved to cache
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8bae90>
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_2acf914d8f962984560ffea505502d12.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_2acf914d8f962984560ffea505502d12.jpg saved to cache
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:48 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 916 | hits on page: 40
2026-03-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e29f64f5-943d-5e80-93a7-07f11492283e with identifier: NG63197
2026-03-27 19:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e29f64f5-943d-5e80-93a7-07f11492283e with identifier: NG63197
2026-03-27 19:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e29f64f5-943d-5e80-93a7-07f11492283e with identifier: NG63197 to the API
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:09:39Z',
 'fuel_type': 'petrol',
 'id': 'e29f64f5-943d-5e80-93a7-07f11492283e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7KHN01',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG63197',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 81623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_b00166c980f4caccf39ae4fb21e3cb42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_9e2d90bb4feb22a14b27691b6eec1cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_5d3433393e7e4af59b7886aa70bf6684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_883ead229ddc9f0b4a59f77bf1b11782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_68aaf6de5d85d81702d67efa57276956.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_8a812fbee4dffaba0f4552a25ea322c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_e82beb54f9ceedb5f8f20dca56a659c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_a3f3e7a53cadb5d82c938dc2989e5a4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_19f120f80300d7db511a960fd6941a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e29f64f5-943d-5e80-93a7-07f11492283e/e29f64f5-943d-5e80-93a7-07f11492283e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/58/6b5885e8b4750a2533802b17eda65719/pa/NG63197_dada0dcc93f5e5696ab930fbda4e109f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG63197%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Saving data for NG63197: {'created_time': 1774638168.388042, 'last_price_update_time': 1774638168.388055, 'auction_closing_time': 1774714179.0}
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG63197') HTTP/1.1" 204 0
2026-03-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_b355a5a85ad939a106bc7778df808147.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for DH84557: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for FS82995: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for LJ95506: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for HH59485: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-27 19:02:48 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-27 19:02:48 [auto1.nl] INFO: Scrape type for BG94378: 0
2026-03-27 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_1977d5bffd4497aa720663c295cd04a8.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cfe10>
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_2e1858f04e049ee768a0ea689ddba686.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_2e1858f04e049ee768a0ea689ddba686.jpg saved to cache
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9cecd0>
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg saved to cache
2026-03-27 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd48c50>
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca30b50>
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_b355a5a85ad939a106bc7778df808147.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_b355a5a85ad939a106bc7778df808147.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_03b92d611309ab269d696fd12bbf75b6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_fc57ff1dca1583452814117b7be0e7f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca29810>
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_1977d5bffd4497aa720663c295cd04a8.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_1977d5bffd4497aa720663c295cd04a8.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb65e10>
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F9a%252Fb09a8774ca12c1b489031112eae64a90%252Fpa%252FFG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c75e861-f8ca-550e-8e56-f257f3a58052
2026-03-27 19:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c75e861-f8ca-550e-8e56-f257f3a58052, skipping ID generation
2026-03-27 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c75e861-f8ca-550e-8e56-f257f3a58052 with scrape type 1
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c75e861-f8ca-550e-8e56-f257f3a58052 sending to next pipeline
2026-03-27 19:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c75e861-f8ca-550e-8e56-f257f3a58052, identifier: FG40185
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c75e861-f8ca-550e-8e56-f257f3a58052 with identifier: FG40185
2026-03-27 19:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c75e861-f8ca-550e-8e56-f257f3a58052 with identifier: FG40185
2026-03-27 19:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c75e861-f8ca-550e-8e56-f257f3a58052 with identifier: FG40185 to the API
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 210,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:54:52Z',
 'fuel_type': 'petrol',
 'id': '5c75e861-f8ca-550e-8e56-f257f3a58052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '27NKL8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG40185',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 204967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_11def92ec922df41ac97cf2309f2892c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_2e1858f04e049ee768a0ea689ddba686.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_0a3947bb1670ca6a693b2fa2920d83cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_b74c3e7e494e1c4b6279bc704873c669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_8186b848308a8ce1f80b9cf4ac912869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f7d5d7746c2e1ede5e2063a83b0026d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_cc8c33e77c1fab55c92842a6294144cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_f842a8f863b3b8ac966ab10b4589f931.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_18c9168fa2f73f3710360d8d1891ff7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5c75e861-f8ca-550e-8e56-f257f3a58052/5c75e861-f8ca-550e-8e56-f257f3a58052_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/9a/b09a8774ca12c1b489031112eae64a90/pa/FG40185_3f79830f5dec5542eee675e852299ce9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2010}
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG40185%27 HTTP/1.1" 200 None
2026-03-27 19:02:49 [auto1.nl] INFO: Saving data for FG40185: {'created_time': 1774638169.78726, 'last_price_update_time': 1774638169.787271, 'auction_closing_time': 1774716892.0}
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FG40185') HTTP/1.1" 204 0
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_d29127b714d848c5fa78d165b476de98.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_1fb0f127b18541507251add5178a580d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU52252> (referer: https://www.auto1.com/v1/car-details-view/WU52252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fbfbf10>
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_03b92d611309ab269d696fd12bbf75b6.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_03b92d611309ab269d696fd12bbf75b6.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfab0e1750>
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252Fbe%252Febbee64698f19da170d872b8d34a3742%252Fpa%252FVC22580_fc57ff1dca1583452814117b7be0e7f6.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_fc57ff1dca1583452814117b7be0e7f6.jpg saved to cache
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed90480f-f56a-56e4-a6e6-283468156c1f
2026-03-27 19:02:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed90480f-f56a-56e4-a6e6-283468156c1f, skipping ID generation
2026-03-27 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed90480f-f56a-56e4-a6e6-283468156c1f with scrape type 1
2026-03-27 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed90480f-f56a-56e4-a6e6-283468156c1f sending to next pipeline
2026-03-27 19:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed90480f-f56a-56e4-a6e6-283468156c1f, identifier: VC22580
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb7e9d0>
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg saved to cache
2026-03-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd54350>
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fdd%252F8add4728889c33a1a7f2842d303b3b25%252Fpa%252FJB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg saved to cache
2026-03-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f0191a4-a2d9-5653-9461-a14e58c94269
2026-03-27 19:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f0191a4-a2d9-5653-9461-a14e58c94269, skipping ID generation
2026-03-27 19:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0191a4-a2d9-5653-9461-a14e58c94269 with scrape type 1
2026-03-27 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f0191a4-a2d9-5653-9461-a14e58c94269 sending to next pipeline
2026-03-27 19:02:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7f0191a4-a2d9-5653-9461-a14e58c94269, identifier: JB49049
2026-03-27 19:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-27 19:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580
2026-03-27 19:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed90480f-f56a-56e4-a6e6-283468156c1f with identifier: VC22580 to the API
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_fc57ff1dca1583452814117b7be0e7f6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:10:41Z',
 'fuel_type': 'petrol',
 'id': 'ed90480f-f56a-56e4-a6e6-283468156c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L371DG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC22580',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 190318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_238231c6b83d65fda0bf93344e97aaa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_bd3b6562ff0f26725ca1bf89a3d5db7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1777981,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_8c298e0e7250aee33f792c49e8d70d13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_978013d520adf9d78b4cac379209f1e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_6428fa5dd8163dcbcc624a4ae0f4c33e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1993968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_deac839bcf2ba8f1a43d22574f5c983e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_490b97a6715c9af5e5f5c20f8f23afd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_f1a0dcbcfee3fdd2de7aa2f60c96b496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_55bbe10b274eb7779afb6efca6418b56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed90480f-f56a-56e4-a6e6-283468156c1f/ed90480f-f56a-56e4-a6e6-283468156c1f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbee64698f19da170d872b8d34a3742/pa/VC22580_fc57ff1dca1583452814117b7be0e7f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2020}
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-27 19:02:50 [auto1.nl] INFO: Saving data for VC22580: {'created_time': 1774638170.626725, 'last_price_update_time': 1774638170.626736, 'auction_closing_time': 1774714241.0}
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VC22580') HTTP/1.1" 204 0
2026-03-27 19:02:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-27 19:02:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049
2026-03-27 19:02:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7f0191a4-a2d9-5653-9461-a14e58c94269 with identifier: JB49049 to the API
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.4L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:55:33Z',
 'fuel_type': 'petrol',
 'id': '7f0191a4-a2d9-5653-9461-a14e58c94269',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB49049',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 239436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3605197,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_75846da9365011d981842ee9fd2ee530.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_7b542ccfd47160575469a3bdc92f1579.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_2e76e36988758ab9f695d014fc6726af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e519b16acdbf6a754a2bc4e876df88f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_9e5f5ec87d21b36c4866c6d02835749f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fba105e2eaccd4b28985a7350bfa326a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_fbdcac66e1bc325504c66633b6c04f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_e77088d564b5e1cdb1a3c78446dbf96b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_3354e8443e11f6795691edf648e17206.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f0191a4-a2d9-5653-9461-a14e58c94269/7f0191a4-a2d9-5653-9461-a14e58c94269_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/dd/8add4728889c33a1a7f2842d303b3b25/pa/JB49049_8ee19fa3f03f69be0162ca1eb504429c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-04-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A4 2.4 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-27 19:02:51 [auto1.nl] INFO: Saving data for JB49049: {'created_time': 1774638171.00406, 'last_price_update_time': 1774638171.004071, 'auction_closing_time': 1774716933.0}
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JB49049') HTTP/1.1" 204 0
2026-03-27 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD85786/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU71978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff2bf90>
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F2b%252Fb92b7adf66a2832597561e032806b4b1%252Fpa%252FHH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg saved to cache
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7dfe98e8-9de2-5539-996a-0a94db378a76
2026-03-27 19:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7dfe98e8-9de2-5539-996a-0a94db378a76, skipping ID generation
2026-03-27 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfe98e8-9de2-5539-996a-0a94db378a76 with scrape type 1
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7dfe98e8-9de2-5539-996a-0a94db378a76 sending to next pipeline
2026-03-27 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7dfe98e8-9de2-5539-996a-0a94db378a76, identifier: HH96879
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c940390>
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F90%252Fdb90cb502b48f4118e757aaf14501288%252Fpa%252FUD40907_d29127b714d848c5fa78d165b476de98.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_d29127b714d848c5fa78d165b476de98.jpg saved to cache
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b
2026-03-27 19:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b, skipping ID generation
2026-03-27 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with scrape type 1
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b sending to next pipeline
2026-03-27 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b, identifier: UD40907
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca87010>
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Ffa%252F4efa18c327083fff2a2f7877d814226f%252Fpa%252FHR88481_1fb0f127b18541507251add5178a580d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_1fb0f127b18541507251add5178a580d.jpg saved to cache
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e81360d-d5fc-56b3-826b-ddc4e5870425
2026-03-27 19:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e81360d-d5fc-56b3-826b-ddc4e5870425, skipping ID generation
2026-03-27 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e81360d-d5fc-56b3-826b-ddc4e5870425 with scrape type 1
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e81360d-d5fc-56b3-826b-ddc4e5870425 sending to next pipeline
2026-03-27 19:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e81360d-d5fc-56b3-826b-ddc4e5870425, identifier: HR88481
2026-03-27 19:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with identifier: WU52252
2026-03-27 19:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with scrape type 1
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_3c5c2678d80023e3fe895bf71f20c835.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3c5c2678d80023e3fe895bf71f20c835.jpg not downloaded yet
2026-03-27 19:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7dfe98e8-9de2-5539-996a-0a94db378a76 with identifier: HH96879
2026-03-27 19:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7dfe98e8-9de2-5539-996a-0a94db378a76 with identifier: HH96879
2026-03-27 19:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7dfe98e8-9de2-5539-996a-0a94db378a76 with identifier: HH96879 to the API
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 184,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'petrol',
 'id': '7dfe98e8-9de2-5539-996a-0a94db378a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '27RBGS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH96879',
 'listing': 'auction',
 'location': 'NL, Nijmegen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 176606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_802fe0ce7b767a1a8bc8d7d9dd93e205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d54f2f2d9ccbc93c0817d3b346cc0e1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_e45479d4ec653c33b7b2c4fe39c5c702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_d55f65f91a849c9b9ec93eb2497f1d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfe98e8-9de2-5539-996a-0a94db378a76/7dfe98e8-9de2-5539-996a-0a94db378a76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/2b/b92b7adf66a2832597561e032806b4b1/pa/HH96879_bbeeacce4c46b09a045a82a7e83639a7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2005}
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH96879%27 HTTP/1.1" 200 None
2026-03-27 19:02:51 [auto1.nl] INFO: Saving data for HH96879: {'created_time': 1774638171.775231, 'last_price_update_time': 1774638171.775242, 'auction_closing_time': 1774715591.0}
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH96879') HTTP/1.1" 204 0
2026-03-27 19:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-27 19:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907
2026-03-27 19:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b with identifier: UD40907 to the API
2026-03-27 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_d29127b714d848c5fa78d165b476de98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:51Z',
 'fuel_type': 'petrol',
 'id': '8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '19KLL9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD40907',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 191741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_d29127b714d848c5fa78d165b476de98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_fe8417ed50f5c44de5ea2f509280a013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_510e6373ea191117ba73ae5b937afef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_cf60ee55eb338ff6603775919dd59a56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b/8849dd30-cd9a-50ef-bbf6-ae5fcf364b6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/90/db90cb502b48f4118e757aaf14501288/pa/UD40907_e51c9741ccad216cb08f23cfd9ce7230.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.8 Black Magic',
 'transmission': 'manual',
 'trim': 'Black Magic',
 'year': 2010}
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Saving data for UD40907: {'created_time': 1774638172.177141, 'last_price_update_time': 1774638172.177151, 'auction_closing_time': 1774716531.0}
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD40907') HTTP/1.1" 204 0
2026-03-27 19:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-27 19:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481
2026-03-27 19:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e81360d-d5fc-56b3-826b-ddc4e5870425 with identifier: HR88481 to the API
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_1fb0f127b18541507251add5178a580d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:10:34Z',
 'fuel_type': 'petrol',
 'id': '8e81360d-d5fc-56b3-826b-ddc4e5870425',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '30KHV2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR88481',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 178866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_3d1510f07846eab10c5d2eb6272a2cc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_0baad28eb0651abe63f32ffbc55ed318.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_b1c1b21d4106ebcec7d6ef0757e7b2a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_88c89d02f77fd0c480c8023e082cfa14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_1fb0f127b18541507251add5178a580d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e81360d-d5fc-56b3-826b-ddc4e5870425/8e81360d-d5fc-56b3-826b-ddc4e5870425_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/fa/4efa18c327083fff2a2f7877d814226f/pa/HR88481_f71df60953ccb2850dec1e47ee71c479.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2009}
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Saving data for HR88481: {'created_time': 1774638172.479381, 'last_price_update_time': 1774638172.479391, 'auction_closing_time': 1774714234.0}
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HR88481') HTTP/1.1" 204 0
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_34598473d7e9d63947bb467f521ec389.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_34598473d7e9d63947bb467f521ec389.jpg not downloaded yet
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_7babd0ee750c789bfceb7d143e730300.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_7babd0ee750c789bfceb7d143e730300.jpg not downloaded yet
2026-03-27 19:02:52 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 916 | hits on page: 36
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_adddc16ac2469faee384664f3a04ab37.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_adddc16ac2469faee384664f3a04ab37.jpg not downloaded yet
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ZZ44063: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for DK51310: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ZK51232: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-27 19:02:52 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-27 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_e7e2b7ee0cb077e084994713d395d98a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e7e2b7ee0cb077e084994713d395d98a.jpg not downloaded yet
2026-03-27 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3c5c2678d80023e3fe895bf71f20c835.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_34598473d7e9d63947bb467f521ec389.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_afc9237724d3f591fcac5c3cf65c670c.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_afc9237724d3f591fcac5c3cf65c670c.jpg not downloaded yet
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg not downloaded yet
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg not downloaded yet
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_9956c9f445504897d0989c9bf185a839.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_9956c9f445504897d0989c9bf185a839.jpg not downloaded yet
2026-03-27 19:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_d7805877e1c1e8719bb670c82036a550.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_d7805877e1c1e8719bb670c82036a550.jpg not downloaded yet
2026-03-27 19:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff8c210>
2026-03-27 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F4a%252F624a95867339c6c3fed3db89f954ebc2%252Fpa%252FJN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg saved to cache
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f7e7017-7079-5943-8946-ee9d2f995822
2026-03-27 19:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f7e7017-7079-5943-8946-ee9d2f995822, skipping ID generation
2026-03-27 19:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f7e7017-7079-5943-8946-ee9d2f995822 with scrape type 1
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f7e7017-7079-5943-8946-ee9d2f995822 sending to next pipeline
2026-03-27 19:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4f7e7017-7079-5943-8946-ee9d2f995822, identifier: JN86544
2026-03-27 19:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c9393d0>
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg saved to cache
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-27 19:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544
2026-03-27 19:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4f7e7017-7079-5943-8946-ee9d2f995822 with identifier: JN86544 to the API
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'petrol',
 'id': '4f7e7017-7079-5943-8946-ee9d2f995822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XR-424-V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN86544',
 'listing': 'auction',
 'location': 'NL, Roosendaal',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 222355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_cdcc4909893deebd3e31323029a6950b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_7e74d75e84d892ade8cfbb3c13e090d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065782,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_76856cb7f169b017c6aaa504dbe75ee4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_00e95646558e515a369865fba1bf77b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_8b5620131f3e5b7fce47b8c3f2743bc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_2acf914d8f962984560ffea505502d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_9fec0f7c7260ab4f4c49b1e40f9dbc5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_1977d5bffd4497aa720663c295cd04a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_b355a5a85ad939a106bc7778df808147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f7e7017-7079-5943-8946-ee9d2f995822/4f7e7017-7079-5943-8946-ee9d2f995822_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/4a/624a95867339c6c3fed3db89f954ebc2/pa/JN86544_04fb96c1b0d159d7653f9783d166b6fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2016}
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-27 19:02:53 [auto1.nl] INFO: Saving data for JN86544: {'created_time': 1774638173.655118, 'last_price_update_time': 1774638173.655129, 'auction_closing_time': 1774714579.0}
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN86544') HTTP/1.1" 204 0
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fda2250>
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_3c5c2678d80023e3fe895bf71f20c835.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3c5c2678d80023e3fe895bf71f20c835.jpg saved to cache
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9c8bb510>
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_34598473d7e9d63947bb467f521ec389.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_34598473d7e9d63947bb467f521ec389.jpg saved to cache
2026-03-27 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8febed50>
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fe0%252F74e006c610021f8d465cb366df047454%252Fpa%252FUD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecb22b31-342a-51b0-b868-f626f0176ef5
2026-03-27 19:02:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecb22b31-342a-51b0-b868-f626f0176ef5, skipping ID generation
2026-03-27 19:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb22b31-342a-51b0-b868-f626f0176ef5 with scrape type 1
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecb22b31-342a-51b0-b868-f626f0176ef5 sending to next pipeline
2026-03-27 19:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ecb22b31-342a-51b0-b868-f626f0176ef5, identifier: UD56346
2026-03-27 19:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ecb22b31-342a-51b0-b868-f626f0176ef5 with identifier: UD56346
2026-03-27 19:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ecb22b31-342a-51b0-b868-f626f0176ef5 with identifier: UD56346
2026-03-27 19:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ecb22b31-342a-51b0-b868-f626f0176ef5 with identifier: UD56346 to the API
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'petrol',
 'id': 'ecb22b31-342a-51b0-b868-f626f0176ef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GGJ56B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD56346',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 23464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_0fcaf16702c0cc2287351fca92f36a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2162337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_56873cc61bf9e0d6932ae5c007398ca7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_e8b77baa104fd720aac00ad5ca55ff61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_9dc8fefdcbfdb9c0291e64db95907cca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_93c8154b445a03712c02fe570a791267.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_2a702aba862365eb3b1866fa6d7fa21d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_03b92d611309ab269d696fd12bbf75b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_02a2a460752c4bad871c7e1d74a31e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2242689,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_61c5f7704d8c998c1ee67c7af79904ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb22b31-342a-51b0-b868-f626f0176ef5/ecb22b31-342a-51b0-b868-f626f0176ef5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2363293,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/e0/74e006c610021f8d465cb366df047454/pa/UD56346_67637ceb318f8f0bfdfe34a4c203489a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD56346%27 HTTP/1.1" 200 None
2026-03-27 19:02:54 [auto1.nl] INFO: Saving data for UD56346: {'created_time': 1774638174.405878, 'last_price_update_time': 1774638174.405888, 'auction_closing_time': 1774715840.0}
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD56346') HTTP/1.1" 204 0
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_7babd0ee750c789bfceb7d143e730300.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd74fd0>
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_7babd0ee750c789bfceb7d143e730300.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_7babd0ee750c789bfceb7d143e730300.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_d7805877e1c1e8719bb670c82036a550.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e7e2b7ee0cb077e084994713d395d98a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_afc9237724d3f591fcac5c3cf65c670c.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_9956c9f445504897d0989c9bf185a839.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca28390>
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_d7805877e1c1e8719bb670c82036a550.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_d7805877e1c1e8719bb670c82036a550.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca95350>
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_e7e2b7ee0cb077e084994713d395d98a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e7e2b7ee0cb077e084994713d395d98a.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fd237d0>
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_afc9237724d3f591fcac5c3cf65c670c.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_afc9237724d3f591fcac5c3cf65c670c.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8ff21a90>
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_9956c9f445504897d0989c9bf185a839.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_9956c9f445504897d0989c9bf185a839.jpg saved to cache
2026-03-27 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_adddc16ac2469faee384664f3a04ab37.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf8fc7add0>
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_adddc16ac2469faee384664f3a04ab37.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_adddc16ac2469faee384664f3a04ab37.jpg saved to cache
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:55 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 916 | hits on page: 0
2026-03-27 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU71978> (referer: https://www.auto1.com/v1/car-details-view/VU71978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD85786> (referer: https://www.auto1.com/v1/car-details-view/SD85786/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 19:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9cb3d890>
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg saved to cache
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdf9ca90950>
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252Fe9%252Fdde97c03d6e31ad52fa86f2d616034be%252Fpa%252FWU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg') HTTP/1.1" 204 0
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg saved to cache
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8
2026-03-27 19:02:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8, skipping ID generation
2026-03-27 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with scrape type 1
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 sending to next pipeline
2026-03-27 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8, identifier: WU52252
2026-03-27 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-27 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb886aed-1167-53f0-9d2f-9f5f3a00741d with scrape type 1
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fb886aed-1167-53f0-9d2f-9f5f3a00741d
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fc3%252Fbcc3baa69daae5b0e2d22808cc77a119%252Fpa%252FVU71978_c1d1688476a06f40f5cb0c1a6d8a45a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c1d1688476a06f40f5cb0c1a6d8a45a1.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fc3%252Fbcc3baa69daae5b0e2d22808cc77a119%252Fpa%252FVU71978_5367f9bb6ae9964b92f21f93b4fa5999.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_5367f9bb6ae9964b92f21f93b4fa5999.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fc3%252Fbcc3baa69daae5b0e2d22808cc77a119%252Fpa%252FVU71978_c8ad8184d3dd913b4aeac4c077538e64.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c8ad8184d3dd913b4aeac4c077538e64.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fc3%252Fbcc3baa69daae5b0e2d22808cc77a119%252Fpa%252FVU71978_3dfa137b44587377cdd117254e243128.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_3dfa137b44587377cdd117254e243128.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fc3%252Fbcc3baa69daae5b0e2d22808cc77a119%252Fpa%252FVU71978_a6dbe5325114ce73b7fd1d90c0a716c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_a6dbe5325114ce73b7fd1d90c0a716c6.jpg already downloaded
2026-03-27 19:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fb886aed-1167-53f0-9d2f-9f5f3a00741d, identifier: VU71978
2026-03-27 19:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-27 19:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b15ab99d-b245-5ac3-8467-1ba7d57fe263 with scrape type 1
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b15ab99d-b245-5ac3-8467-1ba7d57fe263
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_91a5bcce0f9c5dc56a465fd8220ceb8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91a5bcce0f9c5dc56a465fd8220ceb8f.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_7d8415d4dba401c77790a124b6334661.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_7d8415d4dba401c77790a124b6334661.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_95bb1a97bc0dee3c2bd0f324be18393b.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_95bb1a97bc0dee3c2bd0f324be18393b.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_9cc46af79d00a5c156e3e012f4876496.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_9cc46af79d00a5c156e3e012f4876496.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_aead222724e41b770aa781db40e005e7.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_aead222724e41b770aa781db40e005e7.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_cd6a10c5875cdef1bf99df46aa3de094.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_cd6a10c5875cdef1bf99df46aa3de094.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_53173d35a5c225842d5335cf8e8bae36.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_53173d35a5c225842d5335cf8e8bae36.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_24a76cbb1bcf72e8803941d04a85a2aa.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_24a76cbb1bcf72e8803941d04a85a2aa.jpg already downloaded
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_2ed09995600772b90a96f71850565fa3.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_2ed09995600772b90a96f71850565fa3.jpg already downloaded
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252F33%252Ff1332345b25c870b435b69f8bb2d0a02%252Fpa%252FSD85786_91835a49b59403cfce1c0bff263efd18.jpg%27 HTTP/1.1" 200 None
2026-03-27 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91835a49b59403cfce1c0bff263efd18.jpg already downloaded
2026-03-27 19:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b15ab99d-b245-5ac3-8467-1ba7d57fe263, identifier: SD85786
2026-03-27 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with identifier: WU52252
2026-03-27 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with identifier: WU52252
2026-03-27 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3678fdc5-4e0b-56a4-af9d-3a2ea072cda8 with identifier: WU52252 to the API
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:40:38Z',
 'fuel_type': 'petrol',
 'id': '3678fdc5-4e0b-56a4-af9d-3a2ea072cda8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GB754H',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU52252',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 166263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3c5c2678d80023e3fe895bf71f20c835.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_34598473d7e9d63947bb467f521ec389.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_7babd0ee750c789bfceb7d143e730300.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758842,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_adddc16ac2469faee384664f3a04ab37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e7e2b7ee0cb077e084994713d395d98a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_afc9237724d3f591fcac5c3cf65c670c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391950,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_e0e9cd86399ee197237fdc04d6667e7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_3ca4e8dd74c3a6202952862d1917e48a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_9956c9f445504897d0989c9bf185a839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3678fdc5-4e0b-56a4-af9d-3a2ea072cda8/3678fdc5-4e0b-56a4-af9d-3a2ea072cda8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/e9/dde97c03d6e31ad52fa86f2d616034be/pa/WU52252_d7805877e1c1e8719bb670c82036a550.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2015}
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU52252%27 HTTP/1.1" 200 None
2026-03-27 19:02:56 [auto1.nl] INFO: Saving data for WU52252: {'created_time': 1774638176.441814, 'last_price_update_time': 1774638176.44183, 'auction_closing_time': 1774716038.0}
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU52252') HTTP/1.1" 204 0
2026-03-27 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-27 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978
2026-03-27 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fb886aed-1167-53f0-9d2f-9f5f3a00741d with identifier: VU71978 to the API
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU71978>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': 'fb886aed-1167-53f0-9d2f-9f5f3a00741d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H807XP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU71978',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 211988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c1d1688476a06f40f5cb0c1a6d8a45a1.jpg',
                'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_5367f9bb6ae9964b92f21f93b4fa5999.jpg',
                'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c8ad8184d3dd913b4aeac4c077538e64.jpg',
                'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_3dfa137b44587377cdd117254e243128.jpg',
                'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_a6dbe5325114ce73b7fd1d90c0a716c6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb886aed-1167-53f0-9d2f-9f5f3a00741d/fb886aed-1167-53f0-9d2f-9f5f3a00741d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c1d1688476a06f40f5cb0c1a6d8a45a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb886aed-1167-53f0-9d2f-9f5f3a00741d/fb886aed-1167-53f0-9d2f-9f5f3a00741d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_5367f9bb6ae9964b92f21f93b4fa5999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb886aed-1167-53f0-9d2f-9f5f3a00741d/fb886aed-1167-53f0-9d2f-9f5f3a00741d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_c8ad8184d3dd913b4aeac4c077538e64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb886aed-1167-53f0-9d2f-9f5f3a00741d/fb886aed-1167-53f0-9d2f-9f5f3a00741d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_3dfa137b44587377cdd117254e243128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb886aed-1167-53f0-9d2f-9f5f3a00741d/fb886aed-1167-53f0-9d2f-9f5f3a00741d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/c3/bcc3baa69daae5b0e2d22808cc77a119/pa/VU71978_a6dbe5325114ce73b7fd1d90c0a716c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-27 19:02:56 [auto1.nl] INFO: Saving data for VU71978: {'created_time': 1774638176.784597, 'last_price_update_time': 1774638176.784608, 'auction_closing_time': 1774714924.0}
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VU71978') HTTP/1.1" 204 0
2026-03-27 19:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-27 19:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786
2026-03-27 19:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b15ab99d-b245-5ac3-8467-1ba7d57fe263 with identifier: SD85786 to the API
2026-03-27 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 19:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD85786>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '3.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'diesel',
 'id': 'b15ab99d-b245-5ac3-8467-1ba7d57fe263',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '65BLPJ',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD85786',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Land Cruiser',
 'odometer': 373169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91a5bcce0f9c5dc56a465fd8220ceb8f.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_7d8415d4dba401c77790a124b6334661.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_95bb1a97bc0dee3c2bd0f324be18393b.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_9cc46af79d00a5c156e3e012f4876496.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_aead222724e41b770aa781db40e005e7.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_cd6a10c5875cdef1bf99df46aa3de094.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_53173d35a5c225842d5335cf8e8bae36.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_24a76cbb1bcf72e8803941d04a85a2aa.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_2ed09995600772b90a96f71850565fa3.jpg',
                'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91835a49b59403cfce1c0bff263efd18.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91a5bcce0f9c5dc56a465fd8220ceb8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_7d8415d4dba401c77790a124b6334661.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_95bb1a97bc0dee3c2bd0f324be18393b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_9cc46af79d00a5c156e3e012f4876496.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_aead222724e41b770aa781db40e005e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_cd6a10c5875cdef1bf99df46aa3de094.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_53173d35a5c225842d5335cf8e8bae36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_24a76cbb1bcf72e8803941d04a85a2aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_2ed09995600772b90a96f71850565fa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b15ab99d-b245-5ac3-8467-1ba7d57fe263/b15ab99d-b245-5ac3-8467-1ba7d57fe263_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/33/f1332345b25c870b435b69f8bb2d0a02/pa/SD85786_91835a49b59403cfce1c0bff263efd18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-02-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota Land Cruiser 3.0 D-4D VX',
 'transmission': 'manual',
 'trim': 'VX',
 'year': 2004}
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-27 19:02:57 [auto1.nl] INFO: Saving data for SD85786: {'created_time': 1774638177.146668, 'last_price_update_time': 1774638177.14668, 'auction_closing_time': 1774714236.0}
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD85786') HTTP/1.1" 204 0
2026-03-27 19:02:57 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 19:02:57 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-27 19:02:57 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774206177 HTTP/1.1" 200 None
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AN95106') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BH92069') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BK13827') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV93657') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY06610') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='BY69294') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA32447') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CA44332') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ44199') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ73584') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP59029') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR46915') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CX65493') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA42867') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF89435') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU57633') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ED45597') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EE29335') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EM58840') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FF96186') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK36702') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP99208') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC64462') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG53685') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GV50634') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD99345') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR69435') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JS55108') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC57622') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC70935') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LK26318') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LN34207') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR89134') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LS22530') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LY23686') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MS22742') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MY15025') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NH91285') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NK14917') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SB52533') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SD99056') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE57095') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW18249') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SZ13719') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA57972') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TE86496') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UM17072') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UP31903') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='US69144') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UX35743') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UZ41940') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD03005') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD94246') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF52620') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL34628') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VZ53985') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP58537') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV78921') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY40554') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XH33240') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XT37512') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XT71834') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YV82331') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YY02684') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YY30862') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZF10261') HTTP/1.1" 204 0
2026-03-27 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK31432') HTTP/1.1" 204 0
2026-03-27 19:02:58 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (213 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-27T19_00_00.jl
2026-03-27 19:02:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 860477,
 'downloader/request_count': 494,
 'downloader/request_method_count/GET': 468,
 'downloader/request_method_count/POST': 26,
 'downloader/response_bytes': 129726831,
 'downloader/response_count': 494,
 'downloader/response_status_count/200': 494,
 'dupefilter/filtered': 7,
 'elapsed_time_seconds': 171.042558,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 19, 2, 57, 934886, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 213,
 'log_count/DEBUG': 5812,
 'log_count/INFO': 5834,
 'memusage/max': 191868928,
 'memusage/startup': 150044672,
 'photo_download_count': 322,
 'request_depth_max': 27,
 'response_received_count': 172,
 'scheduler/dequeued': 494,
 'scheduler/dequeued/memory': 494,
 'scheduler/enqueued': 494,
 'scheduler/enqueued/memory': 494,
 'scrape_type/batch_skipped': 477,
 'scrape_type/new': 72,
 'scrape_type/price_update': 141,
 'scrape_type/skipped': 259,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 172,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.98581840574124,
 'scrapy-zyte-api/mean_response_seconds': 3.9978938852355594,
 'scrapy-zyte-api/processed': 172,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 172,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 171,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 172,
 'scrapy-zyte-api/request_args/httpRequestBody': 26,
 'scrapy-zyte-api/request_args/httpRequestMethod': 26,
 'scrapy-zyte-api/request_args/httpResponseBody': 172,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 172,
 'scrapy-zyte-api/request_args/sessionContext': 172,
 'scrapy-zyte-api/request_args/url': 172,
 'scrapy-zyte-api/status_codes/200': 172,
 'scrapy-zyte-api/success': 172,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 956,
 'source/total_available': 916,
 'start_time': datetime.datetime(2026, 3, 27, 19, 0, 6, 892328, tzinfo=datetime.timezone.utc)}
2026-03-27 19:02:58 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 19:02:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf9e8d4d10>
2026-03-27 19:02:58 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fdf9ea83f10>